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We treat several key stochastic equations for non-Markovian open quantum system dynamics and 
present a formalism for finding solutions to them via canonical perturbation theory, without making 
the Born-Markov or rotating wave approximations (RWA). This includes master equations of the 
(asymptotically) stationary, periodic, and time-nonlocal type. We provide proofs on the vahdity and 
meaningfulness of the late-time perturbative master equation and on the preservation of complete 
positivity despite a general lack of Lindblad form. More specifically, we show how the algebraic 
generators satisfy the theorem of Lindblad and Gorini, Kossakowski and Sudarshan, even though 
the dynamical generators do not. These proofs ensure the mathematical viability and physical 
soundness of solutions to non-Markovian processes. Within the same formalism we also expand 
upon known results for non-Markovian corrections to the quantum regression theorem. Several 
directions where these results can be usefully applied to are also described, including the analysis of 
near-resonant systems where the RWA is inapplicable and the calculation of the reduced equilibrium 
state of open systems. 
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I. INTRODUCTION 

An open quantum system (OQS) is a quantum sys- 
tem that interacts with some environment whose degrees 
of freedom have been coarse-grained over.^ A general 
dynamical non-Mar kovian environment generates noise, 
and brings forth dissipation and decoherence on the sys- 
tem in a way far more complex than the commonly en- 
countered Markovian (white noise) counterpart, whose 
treatment can be argued from purely phenomenological 
grounds. Specifically for the reduced density matrix p 
and corresponding single-time correlations of the open 
system, the non-Markovian dynamics are described by a 
master equation. Exact master equations for the stochas- 
tic dynamics of open quantum systems are, in general, 
out of reach. However, master equations in the form of an 
arbitrary perturbative order (in the system-environment 
interaction) can be derived in a variety of ways [1-3] and 
find application in many branches of physics and chem- 
istry [ - ]. Multi-time correlations add an extra layer 
of complexity in the non-Markovian regime (e.g. finite 
temperature, cutoff, etc.) as we shall discuss. 

In this work we develop a formalism for quantum 
open systems which closely mirrors the more well-known 
canonical perturbation theory applied to Schrodinger's 
equation. For completeness we include some essential 
background material, with the purpose of clarifying some 
previous confusions in concepts, some arising from non- 
strict usage of terminology. We identify new results we 
obtained in the subsection below which require a thor- 
ough buildup of foundational material to derive and ex- 
plain. We also point out connections with recent work 
derived from these results. We describe the organization 
of this paper and a brief summary of each section below. 

A. Summary 

In Sec. II A we start with some preliminary information 
on open systems pertaining to the mathematical struc- 
ture of non-unitary (dissipative) evolution. In particular, 
we wish to distinguish among the various usages of the 
term Markovian with regard to their distinct properties. 
We place the most emphasis on distinguishing the Marko- 
vian representation^ which can be rather superficial, and 
the Markovian process, which is much more important. 
Finally we carefully note the distinction between the in- 
stantaneous dynamical semi-group and all-time algebraic 
semi-group when employing the Lindblad-GKS theorem 
[8, 9]. 



^ Alternatively called 'integrated over' or 'traced out', but note 
that their effects are far from being eliminated: the environment 
backreacts on the system imparting dissipative dynamics and 
quantum decoherence effects in the, thus reduced, 'open system'. 
The main concern for OQS studies is to describe these effects on 
the otherwise closed quantum system 



In Sec. Ill we present a new and much simplified 
derivation of the perturbative time-local master equa- 
tion, which is fairly well-known, and focus primarily upon 
the second-order master equation. It is often suspected 
that these perturbative master equations cannot be em- 
ployed for significant lengths of time, but we find this 
to be more specifically determined by the noise distribu- 
tion. We also explicitly demonstrate how one can test 
for the complete positivity of a non-Markovian master 
equation which is not of Lindblad form. The microscop- 
ically derived master equation indeed passes this test at 
second order. Perturbative solutions are detailed for the 
asymptotically stationary and cyclo-stationary (periodic) 
master equation. Later in Sec. IV we derive the dual 
time-nonlocal master equation and determine it to be 
equivalent to the appropriate perturbative order, at least 
asymptotically. 

In Sec. V we rederive the perturbative non-Markovian 
Quantum Regression Theorem (QRT) corrections in a 
simple manner and examine their structure more care- 
fully. It is shown that, even at late times when the master 
equation has settled down into its stationary limit, the 
dynamics of the system remain non-Markovian as they 
are expected to. 

In Sec. VI we briefiy discuss the quantum Langevin 
equation, which we generalize to handle nonlinear sys- 
tems and couplings. The Langevin equation provides a 
better perspective for determining the effective forces and 
renormalization terms induced by the environment. In 
the master-equation perspective, the effective forces and 
self interactions are not so easily delineated from other 
unitary generators induced by the environment. 

In Sec. VII we give some categorization of the funda- 
mental object of all second-order open-system dynam- 
ics, regardless of formalism: the environmental correla- 
tion function. Highlighted are the decomposition into 
fiuctuations and dissipation, and their relation. Some 
passing mention is given to the correlation function's 
important role in categorizing the decoherence strength 
and a newly discovered fluctuation- dissipation inequal- 
ity, described more thoroughly in Ref. [10, 11] respec- 
tively. Finally, in Sec. VIII we discuss the correlations 
of thermal reservoirs. The correspondences between the 
fiuctuation-dissipation, Kubo-Martin-Schwinger (KMS) 
relations, Boltzmann distribution, and detailed balance 
are drawn. 



B. New Results and Derivatives 

Here we wish to itemize our most important contribu- 
tions in this work and cite derivative works which have 
spawned from these, though this work contains numerous 
additional results. 

• Our first result is the proof of perturbative com- 
plete positivity for master equations which generate 
non-Markovian dynamics and therefore do not take 
the Lindblad-GKS form. This result was expanded 
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upon and applied in Ref. [ ' to demonstrate that 
the environmental correlation function can be used 
as a comparative measure of the amount of irre- 
versible dynamics induced upon the open system, 
which we refer to as the decoherence strength of the 
environment. 

• A key result of this work is the discovery of per- 
turbative solutions for general systems and envi- 
ronments by the application of canonical pertur- 
bation theory to non-Hermitian super operators. 
This result allowed a careful analysis of the RWA 
in Ref. [12], which precisely demonstrated its short- 
comings as compared to the full second-order solu- 
tions. Later this result was applied in Ref. [13] 
to focus upon the unfortunate discovery that all 
perturbative master equations generate solutions of 
lesser accuracy. Then, in Ref. [14], this result 
was applied to the analysis of the evolution of sys- 
tems and environments with proper initial correla- 
tions, whereas the standard treatment is to consider 
an initially uncorrelated system and environment. 
Most recently this result has been used to calculate 
the correct asymptotic state of the open system for 
non- vanishing interaction with a heat bath [1-5, 16], 
which is, in general, not the equilibrium state of the 
closed system. 

• We have discovered a generalization of the 
fluctuation-dissipation relation (FDR), which is an 
inequality (FDI) that applies to arbitrary, non- 
equilibrium environments. In Ref. [11] this result 
was expanded upon in great detail and a strict cor- 
respondence was drawn between our FDI and the 
Heisenberg uncertainty principle (HUP). 



II. ESSENTIAL BACKGROUND IN NEWER 
PERSPECTIVES 

A. Markovian versus Non-Markovian Dynamics 

The environment's effect on the system can, under 
specified condition, be represented as noises or stochastic 
forces exerting different influences on the system. These 
noises can have correlations (memory) which reflect dif- 
fering timescales of the environment (e.g. the temper- 
ature of a heat bath). Such noises are said to be col- 
ored or correlated and the processes containing memo- 
ries they engender or are associated with are called non- 
Markovian.^ In the Markovian limit the timescales of 
the environment are taken to be much shorter than the 
timescales of the system. Such noise is said to white 



^ We urge to use 'colored' or 'correlated' for the nature of noise 
and save the word non-Markovian for processes with memories. 



and the process Markovian; its timescales cannot be re- 
solved by the system. Quantum noise correlations are 
complex, containing both real noise and dissipation (see 
Sec. VII B). Thus we say that for quantum noise, the 
Markovian limit corresponds to all such memories be- 
ing of insignificant duration. This is the more physical 
notion of the Markov property, as given non-Markovian 
dynamics in this sense (1) the quantum regression theo- 
rem does not apply [17], (2) one cannot add Hamiltonian 
terms to the master equation post derivation (e.g. see 
[18]: Sec. 7.1), (3) one cannot add dissipative terms to 
the master equation post derivation (e.g. see [!'•]). 

An open-system master equation is a linear map for 
the reduced density matrix generated via 

p = C{p}, (ILl) 
£o{p} = [-*H,p] , (IL2) 

where, in our open system formalism, H denotes the free 
system Hamiltonian and Co the free system Liouville op- 
erator in the Schrodinger picture.'' The master equation 
is said to have time-local, time-convolutionless, or Marko- 
vian representation if C{t) does not reference the past 
history of states p(r) for t < t. A Markovian repre- 
sentation does not necessarily imply Markovian dynam- 
ics. Non-Markovian processes can readily admit Marko- 
vian representations for their coarsegrained behavior, e.g. 
the exact Quantum Brownian Motion master equation of 
HPZ [18, 20]. Moreover, for any non-Markovian master 
equation of the form 

p{t)= f dTK{t~T)p{T), (IL3) 

with invertible propagator Q{t) : p{0) — > p{t), there is a 
corresponding time-local master equation 

Pit) ^ C{t) Pit) , (II.4) 

where £(i) = git)g^^it) trivially and in this case Oit) 
and thus the master equation can be formally determined 
via Laplace transformation. Eq. (II. 3) and (II. 4) are fully 
equivalent and can both generate non-Markovian dynam- 
ics despite any Markovian representation; all memory ef- 
fects are encoded in the full time dependence of the mas- 
ter equation coefficients themselves. 

Given a time-local master equation, an C constant in 
time is said to be homogeneous while an Cit) variable in 
time is said to be inhomogeneous. Some authors in the 
physics community refer to this distinction as the Marko- 
vian /non-Markovian distinction as such processes can 



^ It is standard to consider Hilbert-space operators (e.g. p) as 
super-vectors and linear operators (e.g. C) on super-vectors 
as super-operators. In this representation, the master equa- 
tion (II. 1) is simply a linear differential equation akin to the 
Schrodinger equation when written in terms of operators. 
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lead to this kind of evolution. However, time-dependence 
in C{t) is also not specific to non-Markovian dynamics, 
as one can couple a time-dependent Hamiltonian system 
to a Markovian environment. For time-dependent mas- 
ter equations which asymptote into a homogeneous form, 
this is known as the stationary limit of the master equa- 
tion. A well-defined stationary limit is also not specific to 
Markovian processes, e.g. the exact QBM master equa- 
tion for a regulated Ohmic coupling. Nor does a station- 
ary limit imply Markovian dynamics therein, as can be 
seen by a damped quantum oscillator's response to forces 
in Ref. [18, 21]. 

In the context of quantum open systems, Markovian 
processes generally result in Lindhlad equations. Lind- 
blad equations generate completely-positive evolution for 
all states at all times. However not all master equa- 
tions which generate completely-positive evolution are of 
Lindblad form, and not all Lindblad equations arise from 
Markovian processes. The relationship between Markov, 
Lindblad, and complete positivity will be discussed more 
thoroughly in Sec. II B. A conflation of the stochastic 
process and representation often results in properties of 
Markovian dynamics being incorrectly applied to master 
equations of Markovian representation. 



1. Quantum Regression Tfieorem 

For a closed system, or open system driven by Marko- 
vian processes, all multi-time correlations of the system 
can be generated by the Liouville operator for the mas- 
ter equation C(t), or more specifically its super-adjoint 
C^(t), Sec. VA. This is what is known as the Quantum 
Regression Theorem (QRT), e.g. for two-time correla- 
tions we have 

(Xi(ii) X2{t2)) = Xi}(ti) {X2}(t2)) . (II.5) 

But for a non-Markovian process, the open-system mas- 
ter equation cannot generate all multi-time correlations 
despite whatever representation the master equation may 
have. This is, in fact, a defining characteristic of the 
Markovian process and has nothing to do with quantum 
mechanics specifically. In classical terms, the Markov 
property can be defined in terms of probabilities of events 
or expectation values of observables. Extending this def- 
inition to the expectation values of quantum observables, 
the Markov property is rather synonymous with the 
QRT. Other definitions of the (quantum) Markov prop- 
erty may not admit a classical correspondence with what 
is well understood to be Markovian and non-Markovian 
in classical probability theory. 

The non-Markovian corrections to the QRT have been 
known for almost three decades [17]. This was first re- 
ported via the projection operator method and has re- 
cently been duplicated and expanded upon with stochas- 
tic Schrodinger-equation techniques [ ] . These correc- 
tions do not vanish in the weak coupling regime, but 



strictly in the white-noise limit. In Sec. V we rederive 
the non-Markovian corrections to the QRT in a simple 
perturbative fashion and express them in a form which 
demonstrates their inherent non-Markovian character. 

2. The Validity of Combining Master Equations 

As a Markovian process is without memory, its re- 
sponse is somewhat system-agnostic. This allows one 
to combine open-system master equations by the sim- 
ple addition of their individual individual super opera- 
tors, under the assumption that the different underlying 
processes are uncorrelated. Let us consider the reduced 
density matrices of systems A and B coupled to identical 
dissipative environments. We then have the open-system 
master equations 

Pa = -*[Ha, Pa] + ^^a{Pa} : (II.6) 

Pb = -*[Hb, Pb] + ^^b{Pb} : (II-7) 

where the Hamiltonians are those of the free systems and 
the corrections to the Liouvillian are introduced via in- 
teraction with the dissipative environment. In the Hamil- 
tonian formalism one can simply add two Hamiltonians 
and arrive at another Hamiltonian, though one might be 
motivated to fix the energy spectrum through renormal- 
ization. One cannot do this with non-Markovian Liou- 
villians, e.g. given some subsystem coupling Hab one 
cannot simply add dissipative terms. 

Pa+b -«[Ha + Hb -I- Hab, Pa+b] 

+ SCaIpa+b} + SCb{Pa+b} , (11.8) 

The above (incorrect) master equation is in general 
completely different from the correct open-system mas- 
ter equation derived from first principles. For non- 
Markovian processes, the environmental contributions 
have a nontrivial dependence (due to memory effects) 
upon the systems' dynamics through their couplings. If 
one changes the system Hamiltonian, then one must also 
change the environmental contributions to be compati- 
ble with the history these new terms will create. This is 
how memory exhibits itself in a time- local representation. 
Moreover, one must also take into account whether or 
not the dissipative environments are separate or shared. 
If the dissipative environment is shared then the two 
subsystems can interact via environmental back-reaction, 
even in the Markovian regime. This effect is also missed 
when simply combining the Liouville operators. 

In a general non-Markovian master equation, the in- 
validity of the above incorrect master equation would be 
readily apparent as it would likely violate positivity, un- 
certainty, etc. Positivity violation will not occur when 
adding Lindblad terms. But if one has a non-Markovian 
Lindblad equation, such as given by the rotating-wave 
approximation, then the mistake has only become more 
subtle and therefore more dangerous. The master equa- 
tion might be completely positive, but it does not corre- 
spond to the dynamics of the physical system considered. 
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The above example of interacting systems coupled to 
an environment should not be surprising. If the envi- 
ronment is thermal, then to zeroth-order in the system- 
environment interaction, the systems should relax to a 
Boltzmann state which includes the system-system inter- 
action Hamiltonian. Obviously this can only happen if 
the master equation coefhcients are aware of the system- 
system interaction. However, this same mistake is of- 
ten applied in more subtle ways. For instance, if the 
system is driven by an external force, then due to non- 
Markovian response the driving terms in the Hamiltonian 
theory and in the open-system master equation are gen- 
erally inequivalent [18, 21]. This is to compensate for 
the difference between the actual nonlocal response of 
the system and the superficial time-local representation 
of the master equation. 

This issue has also been commented on in the con- 
text of cavity QED. The often-used master equation in- 
cludes the Hamiltonian for the atom, intracavity field, 
and atom-field interaction, but the master equation used 
is exactly that of an empty cavity with dissipation plus 
that of an atom spontaneously emitting into empty space. 
This situation is like that depicted in II. 8. Indeed, if one 
begins instead with the atom-cavity system and derives 
the microscopic master equation using the standard tech- 
nique [()], one finds that the master equation has a differ- 
ent dissipative term [23, 24]. As explained in [j^] if the 
spectrum of environmental noise is sufficiently flat then 
the difference is suppressed, which explains the success 
of the standard cavity QED master equation. But not so 
otherwise, which is something often overlooked and could 
lead to mistakes. 



B. Complete Positivity 

Positive maps for a system S will translate the physical 
states of system S (positive-definite, trace-unity density 
matrices in the product Hilbert space of S) strictly into 
physical states. Completely positive maps for a system S 
will additionally provide positive maps for S-l-A, where 
A is an arbitrary ancillary system. Completely positive 
maps are therefore compatible with entanglement to ad- 
ditional degrees of freedom not included in the system. 
Any physical theory of quantum mechanics must take 
all input states and map them in a completely positive 
manner into the future. We will momentarily ignore the 
subtleties and disagreement [25, 20] with this commonly 
accepted wisdom. 

Given an initial-time propagator Q{t) : p{0) — ^ p{t) 
which maps initial states into the future, and which can 
be represented via some basis in Hilbert space 

p{t) = g{t){pio)} , (II.9) 

Om'r(t)^{^G{t)m{j'\}\j) , (11.10) 

preservation of normalization and Hermiticity dictates 



the relations 

^fe,'(t) = %', (11.11) 

i 

while non-complete positivity requires the positivity of 
all bi-quadratic forms 

{i^\e{t)Mm\^/j)>o, (11.13) 

where xp and cf> are Hilbert space vectors. Determination 
of non-complete positivity is an NP-Hard problem [._ ]. 
Choi 's theorem [28] proves that completely-positive maps 
are determined by the positivity of all quadratic forms 

which is (formally) a simple matter of linear algebra to re- 
solve. Note that the propagator's indices are interpreted 
differently from when ordinarily used as a transition ma- 
trix. 

\i'){j'\ ->\i){j\ (Transition Matrix) , (11.16) 

(Choi Matrix) . (11.17) 

The eigen-value decomposition of the positive-definite 
Choi matrix is known as the Kraus representation [20]. 

Just as Choi's theorem characterizes the Lie group ele- 
ments Q{t) of all valid quantum maps, the theorem due to 
Lindblad [ ] and Gorini, Kossakowski and Sudarshan [')], 
in its most general application, characterizes the asso- 
ciated Lie algebra. Specifically, given the exponential 
representation 

Qit) = e*(*) , (IL18) 

then with the assumption of a semi-group structure, i.e. 
gi)*(t) jg g^jgQ ^ group element for 77 > 0, the algebraic 
generator must be of Lindblad form: 

*p = -i[&,p]+^Aij(ej pel - ]- |e]e/,p| j , 

unitary ^ ^ 

dccohcrcnt 

(IL19) 

where the capital indices / and J index the space of 
Hilbert space operators, which can be double indexed by 
Hilbert space vectors as above, with / = ii' and J = jj' 
such that 

ei =eu' . (11.20) 

The operator is Hermitian and A is a Hermitian and 
positive-definite coefficient matrix, with e/ a particular 
operator (or double Hilbert space) basis of representa- 
tion. Such algebraic generators and the dynamics arising 
when the Liouvillian appearing in the master equation 
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has Lindblad form have been extensively studied [-iO- 
39]. Due to non-commutativity, the time-local master 
equation is in general not directly determined by ^{t), 

g{t)^ c{t)g(t), (11.21) 

C{t) = j d7ye+"*(*) *(t) e-''*^*) , (11.22) 
Jo 

and therefore not all valid master equations must be of 
(time-dependent) Lindblad form 

£ p = -z [H + V, p] + ^ 2?,,, (ei pe]-\ {e]e,, p}] , 

(11.23) 

where the Hermitian operator V arises with the existence 
of the non-unitary X> and therefore H -I- V should not be 
identified with the system Hamiltonian. Moreover, we 
will argue that this unitary generator should also not 
(generally) be identified with the renormalized system 
Hamiltonian in Sec. VI A 1. 

This class inequivalence between the instantaneous 
time-translation generators C{t) and the all-time alge- 
braic generators ^{t) does not exist for unitary trans- 
formations, where both share the same adjoint symme- 
try. However, following the generalization of Choi's theo- 
rem on merely Hermitian-preserving maps, one can prove 
that any Hermitian and trace-preserving time-local mas- 
ter equation must have a pseudo-Lindblad form C(t) with 
merely Hermitian "D. The super-operator "D is gener- 
ally referred to as the dissipator in the mathematics lan- 
guage, very different from the sense used by physicists: 
The "dissipation" generated by the dissipator refers to 
that of states, not of energy"'; its signature distinguishes 
between decoherent and recoherent evolution. The "dis- 
sipator" and unitary generator V together contain both 
dissipation and diffusion in the physics usage. In general, 
V should not be considered a renormalization of H. 

The state dissipation generated by the dissipator can 
be given a more precise geometrical meaning. For any 
distance D on the space of density operators which is 
constructed from a monotonia metric (e.g. trace distance 
or Bures distance), then CP evolution cannot cause any 
Hilbert-space distances to expand [ ' ] . 

D[g{t)p„g{t)p,]<D[p,,p^]. (11.24) 

From this result it is easy to prove that positive-definite 
dissipators contract the state-space volume, whereas 
negative-definite dissipators expand the state-space vol- 
ume (as they appear to be time-reversed contractions). 

Testing for the complete positivity of a time-dependent 
master equation involves a bit more effort than a determi- 
nation of 'D{t) > in the pseudo-Lindblad C{t). A Lind- 
blad form master equation is sufficient but not necessary. 



* Later in Sec. VII B 2 it will be shown that the signature of the 
damping kernel distinguishes between energy dissipation and am- 
plification, and that energy amplification can accompany state 
dissipation. 



In Sec. HI A 3 we prove that all microscopically-derived 
second-order master equations are completely positive to 
second order. We show that the corresponding weak test 
for complete positivity in an arbitrary (time-local) master 
equation is that the pseudo-dissipator is not necessarily 
positive-definite for all times but for all running averages 
while in the interaction picture: 

/ dr^(r) > 0. (IL25) 

A similar analysis exists to check for higher-order consis- 
tency. 

1. Physical Limitations of the Lindblad Master Equation 

Any time-local master equation which preserves the 
trace and complete positivity for every time translation 
ti ~^ ^2 given arbitrary state p(ti) must be of Lindblad 
form. This is not exhaustive of all valid theories. Quan- 
tum open systems provide valid master equations which 
are generally not of Lindblad form. In the simplest mod- 
els of quantum open systems, one begins at some ini- 
tial time to with an uncoupled and uncorrelated (factor- 
ized) system S and environment E. The system and en- 
vironment are then coupled together via an interaction 
Hamiltonian and the environmental degrees of freedom 
are traced over to obtain the open-system dynamics of 
only S. It is a trivial matter to show that all initial system 
states p(io) will evolve in a completely positive manner. 

g{t,to):p{to)^p{t), (11.26) 

but the intermediate mappings 

git2,ti)^git2,to)g{ti,to)-\ (11.27) 

are not necessarily completely positive. The total vol- 
ume of possible physical states can shrink such that an 
arbitrary intermediate state p(ii) can fall into the cat- 
egory of impossible physical states, or states which did 
not evolve from any physical state at to. Such a state 
can then evolve into the category of unphysical states at 
a later time t2 and there is nothing fundamentally wrong 
with this; it is an irrelevant evolution which has nothing 
to do with any physical prediction of the theory. This is a 
typical feature of non-Markovian master equations; they 
can generate a less uniform decoherence than Lindblad 
equations. 

In summary, completely-positive maps are much less 
useful outside of the Markovian regime, as one rarely 
has the all-time maps. "All-time" here meaning that 
the maps must describe all times wherein there may not 
be any correlation to anything. More precisely, such a 
map would have to describe the entire universe from its 
very birth. Typically and empirically, one usually has 
information only pertaining to the two-time maps of some 
limited set of states. These maps are not completely 
positive in the non-Markovian regime and not much is 
known about them. 
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III. TIME-LOCAL MASTER EQUATIONS 

A. Perturbative Master Equations 

We consider a fairly general microscopic model of an 
open quantum system, comprising a quantum system, 
its environment, and system-environment interaction, all 
separable in the Hamiltonian. In the Schrodinger picture, 
the combined closed system (system + environment) dy- 
namics may be expressed 

|pcW = ^c(t)PcW = HHc(t),Pc(<)] , (III.l) 
Hc(t) = HF(i) + Hi(i), (III.2) 

where a subscript C refers to quantities of the closed sys- 
tem (combined with its environment), F subscript quan- 
tities refer to the free system + environment without in- 
teraction, and I subscript quantities refer to the system- 
bath interaction. S and E subscript quantities will refer 
to system and environment quantities respectively; quan- 
tities without subscripts will always refer to the system 
as the vast majority of this work is with regards to the 
open system;' 

We will now proceed with a derivation of the open- 
system dynamics, under the assumption that we may 
treat the effect of the environment upon the system 
perturbatively. At least initially we will take the ini- 
tial state of the system -I- environment to be uncorre- 
lated, Pc(0) = Ps(0) (8 Pe(0)> uncoupled for all 
previous times. Without abandoning the linear master- 
equation formalism, the existence of initial-time system- 
environment correlations are considered in Ref. [1 !]. 

Rotating Eq. (III.l) from the Schrodinger picture to 
the interaction (Dirac) picture, the equivalent integral 
equation of motion is 

g^{t) = i+ fdTC,{T)g^{T), (III.3) 

Jo 

where the interaction-picture propagator and super- 
operators are defined 

ac(i) = aF(t)£cW' 
c,{t)^gF{t)Cjit)gp\t). (111.5) 

This integral equation is directly amenable to perturba- 
tion theory via a Neumann series. Tracing over the en- 



To be more specific on the terminology, when the degrees of 
freedom in an environment E are overwhelmingly greater than 
those in the system, we call E a reservoir (In most cases this is 
assumed to be the case, but for small quantum systems it helps 
to make such a distinction as the physics could be very different.) 
When the reservoir is at a finite temperature we call it a bath = 
thermal reservoir. It is then that the temperature T appears, yet 
the system is in no sense at equilibrium. 



vironment we then have 

g{t)^i+ fdniC.in))^ (in.6) 
Jo 

+ fdnf dT2 (£i(ti) £i(t2))e + • • • , 

Jo Jo 

for the open-system propagator or transition matrix. 
Note that this perturbative series has a time-secular be- 
havior and is of little direct use. But given some level 
of approximation to the propagator, we can then extract 
an approximate open-system Liouvillian via the relation 
C{t) = g{t)g''^{t) or equivalently 

c{t) = Co{t) + g„{t)g{t)g'\t)g^\t). (111.7) 

Assuming the odd moments of the environment vanish, 
which is always true for a Gaussian noise distributional 
(e.g. coupling to an environment of oscillators with linear 
environment operators), we only require the perturbative 
expansions 

a(i) -£2(0 +£4 (<) + ••• , (in.8) 
g-i(t) = 1 -£2 (<) + ••• , (IIL9) 

where the inverse propagator can also be generated via 
Neumann series, though it will involve a double summa- 
tion. Ordinary perturbation in the coupling will then 
yield the following results expressed succinctly in the in- 
teraction picture: 

C,{t)= f dT{C,{t)C,{T))^, (III.IO) 

Jo 

C,{t) - /dri Hdr, /'dr3(£i(0^i(ri)£i(T2)£i(r3))E 
Jo Jo Jo 

-C,{t) f drC.ir), (III.ll) 
Jo 

and for stationary environments the Liouville operators 
can be easily expressed in the Schrodinger picture as 

C2{t) ^ fdT {Ci{t) C,{t, t))^ , (III.12) 
Jo 

for the second-order master equation and 

Ciit) = -£2(0 / drC^ir^t) (III.13) 
Jo 

+ f dn f dT2 I dT3{Clit)C,iTl,t)C,iT2,t)C,iT3,t))^ , 

Jo Jo Jo 

for the fourth-order master equation, where two-time 
interaction-picture operators are given by 

c{h,t2) = gF{ti,t2y^ c{h)gF{tut2) , (iii.u) 

and the two-time propagator is given by 

giti,t2) = gih)g-\t2). (m.is) 
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Equivalent perturbative expansions of the open-system 
master equation have been derived by projection opera- 
tor techniques [] ], series expansion of the influence func- 
tional [ ], and coherent unraveling of the influence func- 
tional [o]. 

1. The Second-Order Master Equation 

To specify the second-order master equation in 
Eq. (III. 10), we will first expand the interaction Hamil- 
tonian into a sum of separable couplings. 

Hi(t) =^L„(t)0l„(i), (III. 16) 

n 

with Hermitian system coupling variables L„(t) and col- 
lective environment coupling variables l„(i). The envi- 
ronmental variables should be assumed to be completely 
non-stationary, in that they are off-diagonal in the free 
energy basis of the environment. Any stationary environ- 
mental coupling would commute with the free environ- 
ment Hamiltonian and could be effectively absorbed into 
the free system Hamiltonian at this order. The second- 
order master equation can be expressed 

^2P=^2 P (^"™* ■'-'™)^ ^ (A„toO L„) p] , 

nm 

(III.17) 

where the A operators and o product define the second- 
order operators 

(A„„iOL„j)(i) = / dTanmit,T) {go{t,T)LrniT)} , 

Jo 

(III.18) 

in terms of the (multivariate) environmental correlation 
function 

a„™(t,T) = (l„(i)l„(r))E , (III.19) 

which will be discussed more thoroughly in Sec. VII. For 
now simply note that the correlation function is Hermi- 
tian and positive definite. The pseudo-Lindblad coeffi- 
cients of this master equation can then be expressed 

V = ^ rL„ (A„„o L„i) - {A,l„^o L„j)^ L„l , 

nm 

(in.20) 

for the unitary generator and for the dissipator 

T^'n'^jj' = + E I*') 01(A„™oL„)|j') (in.21) 

nm 
nm 

where the dissipator has been evaluated in some basis 
Gii' = given representation (11.23). Though the 

second-order master equation is not of Lindblad form, in 
Sec. HI A 3 we prove that it generates dynamics which 
are completely positive to second order. 



2. Validity of the Late-Time Limit 

The second-order Liouvillian C2 (t) can have a well de- 
fined late-time limit for many environments. But be- 
cause of the convergence of C2{t), this necessarily im- 
plies that the C2 contribution to C4{t) in Eq. (HI. 11) has 
the potential to give rise to an 0{t) secular term. Even 
assuming an asymptotic limit for the lower-order per- 
turbative master-equation coefficients, secularly-evolving 
higher-order terms could invalidate taking the late-time 
limit after the perturbative expansion. We will argue 
that the second-order master equation is exempt from 
this worry, and that higher-order perturbative master 
equations can also be acceptable if (1) the environment is 
Gaussian (in its cumulants) to that order of perturbation 
and (2) the correlation function is sufficiently localized. 

First we must express the fourth-order Liouvillian 
strictly in terms of time-ordered integrals. 

C^it) = fdn fdT^ rdT3[{C,{t) C,{n) C,iT2) C,iT3)\ 
Jo Jo Jo 

-(^l(i)^l(Tl))E(^l(T2)£i(r3))E 

-(^i(t)£i(r2))E(^i(Ti)£i(r3))E 

- {C,{t)C,{T,))^{C,{n)C,{T2))^] . (III.22) 

The previously discussed secular behavior would appear 
to be now located in the second term of this equation. 
In the two following terms, the arguments of the 2-time 
correlations are intertwined between correlations with re- 
spect to their order of integration. For a Gaussian envi- 
ronment, or an environment which is at least Gaussian to 
this order, the 4-time correlation can then be decomposed 
into a sum of 3 products of 2 2-time correlations. The 
result is difficult to express in standard notation because 
the super-operators do not commute. The integrand of 
the 4-time correlation becomes 

£i(t)£i(ri) Z{^^)C^)+C,{t) £i(ri)£ifT2)£i(r3) 

v 

+ C^{t) C^{t^) C^{t2) C^(t^) , (III.23) 

V ' 

where the brackets denote the pairs of operators being 
traced over with respect to the environment, and we 
would refer the reader to Ref. [2] for a more thorough 
examination of arbitrary orders. Non-commutativity is 
not a problem with the first term of the decomposition, 
which precisely cancels the secular term in Eq. (HI. 22). 
This cancelation of secular terms will continue at higher 
orders of perturbation theory, as long as one can apply a 
Gaussian decomposition to the moments of the environ- 
ment. Therefore Gaussian environments, and possibly 
other environments which admit analogous cumulant de- 
composition, can be effectively described by perturbative 
master equations even in the late-time limit. 

The stability of Gaussian environments bodes well for 
the second-order master equation even when the environ- 
ment correlations are not exactly Gaussian. We can make 
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a Gaussian approximation to the environmental influ- 
ence [41] by truncating the influence phase to quadratic 
order. Because this perturbation is done in the influence 
phase as opposed to the influence functional, it should 
be good for long times as higher-order terms in the in- 
fluence phase should be well controlled. This is essen- 
tially the saddle-point approximation for path integrals. 
From the Gaussian approximation we may then take a 
weak-coupling approximation, which as we have shown 
is also justified for long times, and we will arrive at the 
same second-order master equation that we would have 
gotten if we had never taken the Gaussian approxima- 
tion. Therefore the second-order master equation can be 
safe in the late-time limit because it is also an effectively 
Gaussian approximation. 



3. Complete Positivity 

As explained in Sec. II B, application of the Lindblad- 
GKS theorem to test for complete positivity requires, not 
the time-translation generator, but the algebraic gener- 
ator. Consider the Neumann series, Eq. (III. 6), whose 
terms are given by 



(III.24) 



where tq — t. This series can be contracted into the 
single exponential 



m 



(III.25) 
(III.26) 



where for symmetric noise, e.g. Gaussian, the perturba- 
tive generators can then be found to be 

^^{t) = g^it), (III.27) 
^A{t)^g.{t)~l-glit), (III.28) 



This is equivalent to solving the master equation via Mag- 
nus series [42] in the interaction picture. It should be 
noted that Magnus-series solutions are slightly secular in 
time, since in general the Magnus series has a finite ra- 
dius of convergence [43] . In this context the second-order 
Magnus-series solution will accurately match the correct 
solution to second order at early times, and then only 
match the correct solution to zeroth order at later times, 
wherein it converges to the RWA solution. For some as- 
pects of the solution this accuracy can be improved with a 
less-secular integrator. However, a careful analysis of the 
master equation and its solutions shows that, due to un- 
avoidable degeneracy, the second-order master equation 
is fundamentally incapable of providing the full second- 
order solutions (see Sec. IIIB 1 and Ref. [I-!]). Therefore 
we would not promote these solutions as the second-order 



solutions, but they contain the most information pertain- 
ing to the non-Markovian dissipator that one can extract 
from the second-order master equation. 

The Magnus-series solution to the second-order master 
equation gives rise to the second-order algebraic genera- 
tor 

m = fdr fdr' {C,{t) C,{t'))^ + 0{Ct) , (III.29) 
Jo Jo 

in the interaction picture. In terms of the interaction 
Hamiltonian, the Lindblad coefficients of the algebraic 
generator ^(<) are then 

A..';,y W = fdr fdr'{{m,ir) \^') (/[ Hi(r') , 
Jo Jo 

(III.30) 

given representation (11.23). With the interaction Hamil- 
tonian expanded as a sum of separable operators, as per 
Eq. (HI. 16), the coefficients evaluate to 



^ / dr / dr' {z\ L,„(t) a„„(r', r) {j\ L„(r') [/) , 

nm -'O Jo 

(III.31) 

in terms of the environmental correlation function. Both 
forms are positive-definite quadratic forms, therefore the 
second-order master equation must generate completely- 
positive maps to second order and the second-order 
Magnus-series solution g{t) = Goit) e— 2(*) happens to be 
exactly completely positive. 

The algebraic generator for intermediate transitions is 
not generally of Lindblad form. For ti < t2, the integra- 
tion kernel for ^2(^1) the quadratic form is effectively a 
leading principal minor of the corresponding integration 
kernel of #2(^2)- Therefore, the intermediate transitions 
can only be ensured completely positive (for arbitrary 
states and couplings) given delta correlations or white 
noise. One can also have Lindblad master equations for 
specific system-environment couplings, such as the RWA- 
interaction, but this is a coupling dependent result. 

Finally note that ^2(^) — lod-T C2{t) and therefore 
the weak test for complete positivity in an arbitrary time- 
local master equation is 

/ dr^(r) > 0, (IIL32) 

that the dissipator is on-average positive definite in the 
interaction picture. Higher-order tests for complete posi- 
tivity would rely upon higher-order terms of the Magnus 
series. 



4. Exact Second- Order Master Equations 

In Sec. HI A 2, we have shown that a Gaussian noise 
cumulant decomposition causes the cancelation of poten- 
tially secular terms which would arise at fourth order and 
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higher orders in the master equation. The remaining non- 
secular terms do not cancel because their operator, time, 
and trace ordering are not generally the same. However, 
there are situations where these higher-order terms do 
cancel, specifically when the system coupling operators 
are constant or at least effectively constant when inte- 
grated alongside environmental correlations. Such is the 
case when the noise is delta correlated, in which case 
the system operators do not have time to evolve under 
integration. Also if the system coupling operators com- 
mute with the system Hamiltonian, then they will be 
stationary in the interaction picture and will not evolve 
regardless of environment timescales. Therefore, given 
Gaussian noise, the second-order master equation is ex- 
act for either a Markovian process or stationary coupling. 

For the Markovian process this property can also be 
seen most easily in the influence functional. The in- 
fluence phase trivially resolves into a much more mun- 
dane second-order term. For stationary system cou- 
plings this property can also be seen in the stochastic 
Schrodinger equation and corresponding convolutionless 
master-equation formalism [ ]. In this case the effective 
noise derivative can be exactly solved for, as it is com- 
pletely lacking in dynamics. 

5. The Born-Markov Approximation 

The second-order master equation is both consis- 
tent with second-order perturbation in the system- 
environment coupling and consistent with the Marko- 
vian limit, which can be viewed as the zeroth-order limit 
of weak system-energy perturbation. In general, these 
are two radically different regimes. Related to these two 
regimes of validity, the second-order master equation is 
in agreement with the Born-Markov approximation and 
Redfield equation after time localization. The Born ap- 
proximation is to assume the system and environment, 
Pc{t)t to remain factorized in time 

PcW«Ps(i)®PE(0) (111.33) 

with the environment insignificantly influenced by the 
system. This is a reasonable approximation in the weak- 
coupling regime. The Markov Approximation is then 
said to approximate environment correlations as delta 
correlations when integrated alongside system variables. 
When used together in deriving the open-system master 
equation these two approximations constitute the Born- 
Markov Approximation ['']. The often stated Markov ap- 
proximation in the interaction picture is 

Pit) = fdr {C,{t) £i(r) p(r)) , (III.34) 
Jo 

« fdT{Ca{t)Ca{T))^p(t). (III.35) 
Jo 

Note that the density matrix can be pulled out of the 
integral if the remaining kernel is a delta correlation. Fi- 



nally, the stationary limit of the master equation coeffi- 
cients often accompanies this approximation. 

It may seem curious that the Born-Markov approxima- 
tion is more generally consistent with the second-order 
(in the system-environment interaction) master equa- 
tion, even when far from the Markovian regime such 
as for zero-temperature reservoirs with moderate cut- 
off frequencies. In general, a Markovian approxima- 
tion is not reasonable outside of the Markovian or near- 
Markovian regime. Indeed if one were to apply the very 
same Markov approximation to remaining system vari- 
ables still inside the integral of Eq. (III. 35), then the re- 
sult would be incorrect outside of the Markovian regime. 
It is specifically in the Born-Markov approximation, that 
the Markov approximation is consistent with lowest-order 
perturbation theory and does not require highly local- 
ized correlations. The nonlocal effects can only arrive 
at higher-order perturbation regardless of environment 
correlation timescales. This is a typical occurrence in 
integro-differential equations which are only perturba- 
tively nonlocal. 

B. Stationary Master Equations 

In this section we consider the case where all Hamilto- 
nian terms are constant in time. The second-order oper- 
ator (A„„iOLm) in Eq. (HI. 18) is reduced to quadrature 
in the energy basis where it is given by a Hadamard prod- 
uct. 

(wil A„„iO L,„ \uji,) = A„„i \uji,) {uji\ L„j la;.;/) , 

(HI.36) 

with the A„m operator defined 

(WjI A„„ Iwi') = Anm{uJu') , (III.37) 

Anm{t-u)= /dTa„„(i,T)e-*"(*-^), (III.38) 
Jo 

where uju' = uji — Wi'. If the correlation function is sufh- 
ciently localized in time, then these coefficients will have 
a stationary limit. 

It will be useful to decompose A„„j into its Hermitian 
and anti-Hermitian parts in the noise index 

HeK,„(t;c^)] = i [A,,^{t;Lo) + 4*„„(i;c^)] , (III.39) 

AnK,„(t; c^)] = u) - A:„„(t; to)] , (III.40) 

where for a univariate correlation function these will re- 
duce to the real and imaginary parts respectively. Next 
we define the pseudo-stationary correlation 

( a{t+At,t) At < mT/11^ 

with Hermiticity relation cy.t{At) = q;|(— At) and where 
for truly stationary noise one simply has at(At) = 
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a.{At). [By the emboldened a, we mean to imply the 
noise-indexed matrix with elements anm-] AH of the fol- 
lowing calculations may then proceed as if we have a 
stationary correlation. E.g. the characteristic function, 
or power spectral density, is defined to be 



+00 

— 00 



at(r) 



(III.42) 



The full-time master equation coefficients can now be 
represented 



He[yl„™(t; w)] = i St {oj) * a„,„(a;) 



An[^„™(t; w)] 



-Vt 



(III.43) 

*(5t(a;)*(5„„(w), (III.44) 



with * the appropriate Fourier convolution in frequency 
space and the late-time limiting delta function and 
Cauchy principal value defined 



V, 



Stioj) 
1 



_ sm{u!t) 

■KLO ' 
_ 1 — COs{LLlt) 



(III.45) 
(III.46) 



Assuming a sufficiently smooth and localized correlation 
function, the late-time coefficients will then be 



An[A„,„(iu)] 



-V 



(III.47) 
(III.48) 



and thus the late-time coefficients obey a Kramers-Kronig 
relation and are causal response functions. Bochner's 
theorem dictates that positive-definite correlation func- 
tions in the frequency domain will arise from station- 
ary (and positive-definite) correlation functions in the 
time domain. Therefore, for stationary correlations and 
with some assumptions of continuity, the Hermitian co- 
efficients will comprise a positive-definite matrix in the 
late-time limit. 

Perhaps more useful computationally is the Laplace 
representation 



OLt{s) 



dre at{T) . 



(III.49) 



In the Laplace domain, Eq. (III. 38) is merely a frequency 
shift of the correlation function before the time integra- 
tion. 



(III.50) 



and from the final value theorem wc have the late-time 
coefficients 



^nm(w) = Q;„m(«w) . 



(III.51) 



This is generally the fastest method for obtaining the 
late-time coefficients, assuming one has obtained func- 
tions with analytic continuation into the complex plane. 
From the Kramers-Kronig relation, the late-time coeffi- 
cients should be analytic in the upper half of the complex 
plane. 

Finally, the pseudo-Lindblad master-equation coeffi- 
cients can be represented 

Aii'-jj' {uJjll'n |Wj') , (III.52) 

nm 

in terms of the kernel 



(III.53) 



all evaluated in the energy basis en> — \uji){ujii\. In the 
rotating-wave approximation one only keeps the terms 
stationary in the interaction picture of the free system: 

'Dii'-ii' = ^ (Wil Lrn \0Ji') 2}ie[Anm{uJU')] (Wi | L„ \uJi') , 
nm 

(III.54) 



and 



2HeK„(0)]" 



(III.55) 

as well as the corresponding stationary contributions of 
V. These terms are a quadratic form on the correla- 
tion function. If one has a correlation function which 
is stationary, at least in the late-time limit, then the 
RWA coefficients will take on a Lindblad form. Therefore 
the rotating-wave approximation constitutes a Lindblad- 
projection of the master equation. Correspondence be- 
tween the RWA-Lindblad master equation and perturba- 
tion theory is discussed in Ref. [12]. 



1. Second- Order Solutions 

Given sufficiently-localized environment correlations, 
the master-equation coefficients asymptote primarily 
within the environment timescales and secondarily within 
the free-system timescales. Some exact results for linear 
systems are given in Ref. [18] where this behavior can be 
seen explicitly. The short-time relaxation, which occurs 
on the order of the environment cutoff frequency, can be 
particularly violent and the master equation coefficients 
are said to jolt. Such jolts are result of specially cho- 
sen initial conditions where the system environment are 
initially factorized, yet subsequent evolution occurs with 
finite interaction strength. In the context of linear mas- 
ter equations, avoidance of jolts by the preparation of 
correlated initial states or by turning on the interaction 
gradually are discussed in Ref. [14]. 

Therefore given some properly correlated or coupled 
environment, the master equation should asymptote to 
its stationary value smoothly and (for weak coupling) 
within timescales which are much shorter than those of its 
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effects.^ Upon this initial relaxation, the system evolves 
in a manner invariant to time translations 

lim g(i,T) = e(*-^)^(°°) . (III.56) 

t>r»0 

Therefore in the weak-coupling regime it typically suf- 
fices to consider the dynamics generated by the station- 
ary limit of the master equation. As with the time- 
independent Schrodinger equation, one can use canonical 
perturbation theory to compute the stationary propaga- 
tor e*'^. Full-time solutions can also be calculated ana- 
lytically, and to within some perturbative order, via Fer 
expansion [4 .)]. 

Canonical perturbation theory is applied specifically to 
the eigen-value problem 

C-(Tij = fij (Tij , (III. 57) 

where the eigen- values fij and corresponding right eigen- 
operators (Tij of C can be expanded perturbatively in 
powers of the coupling as 

(Tij = \oJi){ujj \ + S(Tij H , (III. 58) 

.nj = -iuj,, + dnj + -- - , (III.59) 

here to second order, where We will assume 

no resonance or near resonance in the energy-level split- 
tings, though it will be more-or-less clear how to apply 
degenerate perturbation theory to these cases. By con- 
struction, the zeroth-order terms are set correctly. The 
second-order terms are set by the corresponding order of 
terms in the master equation: 

{iO,,\C2{\L^;){iO,\}\iOy) = (III.60) 
- l{uJij-(jJi,j:) {uJi, \ ScTij \ujj,) + Sftj . 

Evaluating the components of this equation yields the 
non-degenerate corrections 

I S(T^, |.,,) = (ni.6i) 

— t(UJij—UJi'j') 

Sf,, = (c^,| £2{k.)(w,|} , (III.62) 

where cdij ^ ujiiji. The second-order timescales fij are 
determined strictly by the RWA coefficients, Eq. (III. 54)- 
(III. 55). The non-degenerate perturbative frequency 
shifts are found to be 

^fiJ X! ki) 2IIe[A„„i(0)] {ujj\ L„ \ujj) 

nm 

- ^ (Wfc|L,„|lLJi)A„„(lLJfei)(wfe|L„ \uJi) 
runk 

- (^k\^rn \uJj) A*^^{u}kj){u}k\'Ln \ujj) . (III.63) 
nmk 



® Multipartite systems in relativistic fields also experience retarded 
jolts. See, e.g. Ref. [1-5, 11]. These are also peculiarities associ- 
ated with factorized initial states. 



This relation reveals that the Hermitian part of Anm{<^) 
only gives rise to the real timescales, i.e. growth and 
decay, while the anti-Hermitian part only gives rise to 
imaginary timescales. Upon completing the square with 
the first term, as we shall do in Eq. (III. 72), one can see 
that He[A„m(a;)] (and thus a{uj) at late time) being pos- 
itive definite will force the real timescales to be negative. 
This decay corresponds to the decoherence of (pertur- 
batively) off-diagonal components of the density matrix 
while in the energy basis. 

Even when far from resonance, the unperturbed eigen- 
operators are always degenerate along the diagonal where 
ujii — and the previous perturbation theory only applies 
to the off-diagonal entries. For the diagonal evolution, 
we need the linear combinations of diagonal entries that 
branch under perturbation. The correct diagonal combi- 
nation 

P^J2p,\uj,){uj,\ , (III.64) 

i 

with second-order eigen-frequency 5f must satisfy the 
characteristic equation 

(t^,| £2{p} = 6f p , (III.65) 

This is also a well defined eigen-value problem. Written 
more conveniently in matrix notation we have 

Wp = 5/p, (III.66) 

with the characteristic matrix and diagonal vector de- 
fined 

IW],^. = (w,|£2{K-)(^j|}|^.) , (III.67) 

[p1,= (w,|pk) , (III.68) 

and where the characteristic matrix evaluates to 

V^^^j = X! ^'^^I ^"^ I'^j) 2He[A„„(cj,y)] {uj,\ L„ , 

nm 

(III.69) 

for i ^ j and for the diagonals 

lWl^ = -J2{^k\W\cu,) . (III.70) 

Note that away from resonance W receives no contribu- 
tion from the anti-Hcrmitian coefficients and is encap- 
sulated by the RWA coefficients. Associated with this 
characteristic equation is the Pauli master equation 

|p = Wp + 0(£2), (III.71) 

though it should be noted that this neglects the second- 
order corrections to the eigen-operators, of which the 
second-order off-diagonal perturbations are obtainable 
directly from the second-order master equation. 

For n energy levels, then there is an order n charac- 
teristic polynomial that needs to be factored. Directly 
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solving the master equation would have been order v? . 
The zero temperature limit is a particularly simple case 
to solve for. W is upper triangular in accord with the 
lack of thermal activation; eigen-values are determined 
by the diagonal entries and eigen-vectors by simple ma- 
trix inversion. 

The diagonal entries |W]^^ are the maximal instan- 
taneous relaxation rates for the perturbatively diagonal 
entries of the density matrix in the energy basis. The per- 
turbatively off-diagonal relaxation (decoherence) rates 
can be expressed 

Re[%] = ^"^^"^ \ ""^^^ - E HeK„(0)] dif' , 

nm 

(in.72) 

given the matrix elements 

= L„ - {oj,\ L„ , (III.73) 

and therefore the decoherence rates are strictly larger 
(more negative) than the (average) maximal diagonal de- 
cay rates. Aside from an overall Markovian limit, only 
the decoherence rates reference Anm (0) or the Markovian 
coefficients. This gives the decoherence rates additional 
sensitivities to the infrared regime (e.g. 1// noise) which 
are not present among the stationary relaxation rates. 
Decoherence can occur on timescales much more rapid 
than thermalization. 

It is not difficult to see from (III. 69) that the columns 
of W are not independent, as they all add up to zero. 
In fact they must do so to preserve the trace of the den- 
sity matrix. Therefore there is always at least one state 
within the null space of W. This is a stationary state 
with characteristic frequency 5f — 0. Any stationary 
master equation must have a stationary state. Depend- 
ing on the details of the model, there may be additional 
stationary states. These will also be energy states (to 
lowest order in the coupling) in accord with the "quan- 
tum limit of einselection" [4()], but here as a simple con- 
sequence of perturbation theory. W is weakly column 
diagonal dominant given a positive definite He[A„„j(w)], 
as will be the case for stationary environment in the late- 
time limit where IIe[A„m(w)] = ia„m(a;). The Gersh- 
gorin circle theorem immediately implies that there can 
only be damped oscillations and that the damping rates 
strictly outpace the oscillation rates. 

Finally we note that second-order diagonal perturba- 
tions to the operators p in the degenerate subspace re- 
quire the fourth-order Pauli master equation, as there 
will be corrections of the form W4//2 because of degen- 
eracy [13]. There is often a mistaken expectation that 
the second- order master equation should produce second- 
order solutions, e.g. complete positivity to second or- 
der, but this is not the case. The range of approxi- 
mations between zeroth and second-order perturbation 
can be organized as follows: zeroth-order limiting solu- 
tions, RWA solutions, solutions to the second-order mas- 
ter equation, and finally the second-order solutions. Each 
successive approximation contains more information than 



the last [ M?], however there can be a trade-off in positiv- 
ity between the RWA and second-order master equation. 
Solutions to the second-order master equation without 
fourth-order Pauli equation can easily violate positivity 
at second order. This is particularly exacerbated by low- 
temperature environments where the asymptotic state 
has a largely vanishing diagonal to zeroth-order and one 
lacks the proper second-order correction to the diagonals 
which are needed to accommodate off-diagonal perturba- 
tions. 



2. The Damping Basts 

The damping basis [47] is simply the basis which di- 
agonalizes C. It is a basis of operators or matrices and 
not necessarily physical states or vectors, as in general 
the eigen-operators crij cannot be expressed as an outer 
product of state vectors. C is not necessarily Hermitian 
or normal in the ordinary sense of linear algebra, and so 
the left eigen-operators are not determined by the super- 
adjoint of the right eigen-operators. This is not to be 
confused with the fact that JC is Hermitian and normal 
in the sense of preserving the Hermiticity and trace of the 
density matrix. The master equation sense of Hermiticity 
implies that the eigen-system has an adjoint symmetry, 
C crjj = f*j (T-j . The master equation sense of normality 
implies that the identity matrix is always a left eigen- 
matrix with eigen-value zero as 

|Tr[p]=Tr[l£p]=0, (III.74) 

for all p; the corresponding right eigen-state to 1 being 
a stationary state. 

In dissipative quantum mechanics we must resort to 
calculating the dual, left eigen-operators (super-vectors) 
cr* such that cr* C — eT*j fij where fij is also the eigen- 
value of the corresponding right eigen-operator ovj. To 
clarify, left and right super-multiplication with super- 
vectors is defined as 

plCp^= J2 (*IPlIj> {^\C{\^'){J'\}\J) (/|PrI/) , 

(III.75) 

and the spectral decomposition of our open-system prop- 
agator can be represented by the sum of outer-products 

e*^ = ^e/..*^^^.^*, (111.76) 
which acts upon states as 

ij y i'j' J 

(111.77) 

The left eigen-operator cr* projects out the cr^ compo- 
nent from p. Perturbatively, the dual vectors can be 
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written cr*- = \uii){uij\ + (5cr*- + 0{Cf), and the second- 
order terms of the left eigen- value equation are then 

(c^,|£2{|c^.'>K'|}K> = (111.78) 

As must be the case, the corresponding eigen-values are 
the same while the left eigen-operators become 

(III.79) 

where 7^ w^'j'. Due to degeneracy, the left eigen- 
vectors of W must be solved non-perturbatively. As for 
the non-degenerate eigen- vectors, their orthogonality re- 
lation perturbatively evaluates to 

+0(£f), (III.80) 

and therefore the eigen-basis is not only perturbatively 
orthogonal but also normalized to second order. 



C. Cyclo- Stationary Master Equations 

Here we will briefly discuss the applicability of second- 
order master equations to time-dependent problems by 
a simple analysis of asymptotically cyclo-stationary mas- 
ter equations. Such master equations can arise when sta- 
tionary free-system dynamics are under the influence of 
cyclo-stationary correlations (defined in Sec. VII A 2) or 
when periodic free-system dynamics are under the influ- 
ence of stationary correlations. 

As a brief review of periodic systems, recall that Flo- 
quet's theory asserts that given a periodic Hamiltonian 
H(i), the free solutions take the form 

t/>(i)=PoWe-'^*V'(0), (III.81) 

for pure states in the Schrodinger picture, where Po(t) is 
a unitary operator with the same period as H(i) and H is 
the time-homogeneous pseudo-Hamiltonian whose eigen- 
values are the pseudo-energy levels. Effectively, Po(i) 
acts as a change of basis between the time-dependent 
Hamiltonian motion and the time-independent pseudo- 
Hamiltonian motion. Po(i) has its own Fourier decom- 
position in terms of the Hamiltonian frequency fin and 
induces a Fourier decomposition upon transformed oper- 
ators 

Pj {t) X Po it) = e''™''"* ' ("1-82) 

u 

with which one can calculate the full spectral decompo- 
sition of Heisenberg picture observables 

{u:,\^{t) \oj,) = ^ X[„] Ic,) e+-'^* , 

(in.83) 



where jw) here denotes the pseudo-energy basis. This 
spectral decomposition, whether for the system or envi- 
ronment, will allow for calculation of the second-order 
master equation coefficients in Eq. (HI. 18) in terms of 
the more mundane stationary coefficients in Eq. (HI. 38). 

Given stationary environment correlations and peri- 
odic system dynamics, the second-order operator 

(w,! PS(t) (A„„ o L„) Po(0 \loj) , (IH.84) 

can be decomposed into 

Ar,,n{Lo,,+unn) e+^""«* , (III.85) 

u 

here evaluated in the free concyclic picture of the sys- 
tem, which will turn out to be more useful than the 
Schrodinger picture. 

Given stationary system dynamics yet cyclo-stationary 
environment correlations as resolved in Eq. (VII. 12), 
the second-order coefficients can be expressed by the 
Hadamard product formulas, Eq. (III.36)-(III.37), with 
the cyclo-stationary coefficients 

An„M = ^ AS(w-z;r!H)e*("-'')"«* , (III.86) 

uv 

where the coefficients J^nm{oj) are calculated also ac- 
cording to Eq. (III. 38), but with the stationary kernels 
OL[uv]{t) given by Eq. (VII. 13). 

In either case the mundane stationary coefficients 
A{u)+uQ.-ii) remain asymptotically stationary and there- 
fore the full coefficients are asymptotically periodic. The 
cyclo-stationary master equation can therefore be repre- 
sented with modulated stationary master equation coef- 
ficients. 



1. Second-Order Solutions 

Let us assume that we have an asymptotically and per- 
turbatively cyclo-stationary master equation of the gen- 
eral form 

p{t) = -I [H, p{t)] + C2{t){p{t)} , (III.87) 
£2(i) =^2(i+r), (III.88) 

where if our system had a periodic Hamiltonian, then we 
would have transformed into the free concyclic picture 
via Po(i) 

p(i)^Pj,(t)p(t)Po(i), (III.89) 

so that the dynamics are zeroth-order stationary and we 
now work with the pseudo-Hamiltonian and concyclic 
dissipator. If our system has stationary dynamics and 
the environment has cyclo-stationary correlations then 
we simply remain in the Schrodinger picture. 
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Floquet's theorem then asserts that there is a peri- 
odic transformation of the density matrix into a ba- 
sis wherein the dynamics are generated by a time- 
independent pseudo-LiouviUe operator £, where 



of the form 



(III.90) 
(III.91) 



Determination of these perturbative corrections can 
be made by Magnus-Floquet series, to be detailed in 
Ref. [ '^]. The easiest terms to calculate are those station- 
ary in the interaction picture, or the RWA coefficients. 
These terms are simply given by the time average of 
the Liouvillian {C{t)) and are sufficient to determine the 
timescale perturbations and degenerate evolution as in 
the stationary master equation. For instance, the RWA 
coefficients corresponding to Eq. (III. 86) are given by 



(A„™(a;)) 



(III.92) 



As with the stationary master equation, the RWA coeffi- 
cients lack some information. Here, the pseudo-energy 
basis is perturbed into a pseudo damping basis and 
there is also some (perturbatively) periodic transforma- 
tion between the cyclo-stationary Liouvillian and pseudo- 
Liouvillian. 

For finite-temperature reservoirs, one can see that 
cyclo-thermalization will not ensue (non-trivially at 
least) as detailed balance (discussed in Sec. VIII A 3) is 
lost with the frequency shifts. The system will still evolve 
towards a cyclo-stationary state, only it will not generally 
be cyclo-thermal. 



IV. TIME-NONLOCAL MASTER EQUATIONS 

Historically, the most general open-system master 
equations were, as first derived, of nonlocal form such 
as in the projection-operator formalism of Nakajima [ ] 
and Zwanzig [■")()]. These nonlocal master equations 
would then be localized via Born-Markov approxima- 
tion or a more careful perturbative analysis. Our sim- 
ple derivation of the convolutionless master equation in 
Sec. Ill A contained no appeal to a nonlocal form. Here 
we will demonstrate the dual non-secular perturbation 
theory can naturally produce a nonlocal master equa- 
tion. We will also discuss similarities between the two 
representations. 



-PcW = /Cc(t)*PcW, (IV.l) 
Kc{t)^KF(t) + Ki{t), (IV.2) 

where * denotes the Laplace convolution. Therefore we 
should expect a perturbative level of agreement between 
the two analyses for closed (system -I- environment) Li- 
ouvillians which are constant in time. In the Laplace 
frequency domain, we have an algebraic equation for the 
closed (system -f environment) propagator 



K.c{s)Qc{s) : 



(IV.3) 



which readily admits perturbative solutions via the Neu- 
mann series 



Qis) =go{s) + {gF{s) iCi{s)gF{s] 



gpis) [Ki{s)gF{s) 

1 

K.f{s] 



(IV.4) 



(IV.5) 



after tracing over the environment. Again, the perturba- 
tive propagator is secular in nature, but we will only use 
it as an intermediate in the perturbative approximation 
of the open-system Liouville kernel. 



Kis) 



(IV.6) 



For Gaussian noise we find the second and fourth-order 
kernels to be 

/C2(s) = go{s)-^ (gpis) [iciis) gF(s)] goi^r^ , 

(IV.7) 

/C4(s) =do(s)-^ (gF{s) [K;i(s)gF(s)]^^ go{s)-' 
-t2{s)g^{s)ic2{s). (IV.8) 

For a stationary environment this simplifies to 



(IV.9) 



Ki{s)^{Ki{s) gF{s)Ki{s) ) ^K2is)gois)K2is). 

(IV.IO) 



B. The Second-Order Master Equation 



K2is)=(Kiis)gFis)Ki{s) 



A. Perturbative Master Equations 

We will consider the same sort of system-environment- 
interaction decomposition, but instead of time-local mas- 
ter equations we consider time-nonlocal master equations 



For a stationary environment with time-local interac- 
tion, the second-order Liouville kernel can be expressed 
in terms of the time-local Liouville operator as 



K.2{t) = t2{t) goit), 



(IV. 11) 
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and for a time-local system Hamiltonian we can addition- 
ally express 



x:2(s){k)(c.,|} = s'£2(s'){k)KI} 



(IV.12) 

in Laplace space. Using Eq. (III. 50), we have the relation 



\An„i{s;uj) 



i{s + Hjj) . 



(IV.13) 



which reveals a particular shift-scale symmetry of the 
nonlocal master equation. The Liouville kernel can there- 
fore be expressed 

1C2{s){\uj,){ujj\} = sC2{s+2iuj,j){\io,){iOj\} . (IV.14) 

In terms of the correlation function a{s), it is more ob- 
vious that while the time-local master equation always 
has Markovian representation, the time-nonlocal mas- 
ter equation only has Markovian representation for the 
Markovian process, or at least when the process appears 
Markovian with respect to the freely-evolving system 
coupling operators. 

Though the Liouville kernel is slightly more difficult to 
express than the time-local analog, the full-time solution 
is simply 



aw 



(IV.15) 



in the Laplace domain. Using the final-value theorem, 
the asymptotic state is 



p(oo) = lim s s — KI(s) p(0) 



(IV.16) 



which, under some assumptions of convergence, is equiv- 
alent to 



p(oo) = lim e*'^(°V(0) 



(IV.17) 



Therefore the stationary operator /C(0) must determine 
the asymptotic state just as the stationary operator 
C{oo) does. By comparison with either (IV.12) or (IV.14) 
we have 



iC2is){\uj^){uJi\} = S C2is){\uj^){uJi\} , 



(IV.18) 



which is sufficient to ensure that the two operators share 
the same zeroth-order stationary states, and second-order 
corrections to any zeroth-order stationary state. 

The late-time dynamics are slightly more involved to 
compare. Ideally, one would decompose the full-time 
propagator into its early and late-time behavior 



(IV.19) 



where Qoois) denotes the late-time local evolution which 
decays slowly with the perturbation, and SQi{s) denotes 
the short-time nonlocal evolution which decays more 
rapidly with system and environment timescales. The 
asymptotically dominant ^oo(s) would then correspond 
to e*^^°°\ possibly modulo some amplitude and phase 
differences. This relation will be demonstrated once we 
have obtained solutions. 



C. Second-Order Solutions 

Our perturbative solutions will follow the spirit of 
canonical perturbation theory. First we inspect the struc- 
ture of the exact solution, which takes the form 



g{.s)= s-Kis) 



(IV.20) 



and is a rational function of the Liouville kernel. Given 
the eigen-system kij{s), dij{s) of iC{s) such that 

K{s) 6,y(s) = k,{s) 6,,(s) , (IV.21) 
then the exact solutions can also be expressed 

(IV.22) 



where o*,j{s) is the left eigen-matrix dual to Oij{s) as 
described in Sec. (IIIB2). We will construct a perturba- 
tive solution from the perturbative eigen-system, which 
will constitute a rational approximation of the exact so- 
lution akin to a Fade approximant. Further note that, 
with /C(s) pcrturbatively truncated, exact solutions to 
the perturbative master equation are already rational ap- 
proximants of the exact solutions, so there is no new kind 
of mangling in doing this. 

The nature of such a perturbative solution is slightly 
different from that of the time-local perturbation. The 
perturbative evaluation of e'^*'^'^*^ is non-secular, but may 
contain slight amplitude and phase discrepancy and can 
only be applied for C{t) commutating or for small dt. The 
nonlocal perturbative solutions are effectively full time, 
but being a rational approximation in Laplace space 
they can introduce some slightly secular behavior. For 
instance, exact timescales can become duplicated with 
small (here fourth-order) error, giving rise to a very slow 
beat frequency. Regardless, we will show these perturba- 
tive solutions to be convergent with the correct asymp- 
totics. 

The second-order eigen-value problem constrains the 
non-degenerate perturbative corrections to be 



uJt'\K.2{s){\uj^){ujj\} \ujj') 

-l{uJij-UJiij') 

for the operator corrections, where Uij ^ uJi'j', and 

Skjis) = {lj,\K2{s){\uj,){lj,\} . (IV.24) 

for the eigen-value corrections. Given the similarity men- 
tioned in Eq. (IV.18), the "frequency" will be perturbed 
by a term analogous to the time-local formula. The eigen- 
value perturbation is particularly important to analyze, 
as the stability of our perturbative solution is dictated 
by its poles, or equivalently the roots of 

s — kij{s) = s + iLOij — Skij{s) -I- • • • , (IV. 25) 
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having negative real part. Assuming the correlation func- 
tion to be well regulated, these poles should occur as per- 
turbations of the system frequencies and perturbations of 
scales which regulate the correlations, such as the cutoff. 
For well-regulated correlations our attention turns to the 
near-resonance poles, s ~ —tujij. We can actually solve 
for these poles perturbatively, they are simply 



Sij = -luJij + Skij{-iujij) + ■ 



(IV.26) 



and are precisely the late-time eigen-values of the time- 
local master equation given the relation 

K:2(-zWy){|c^.)KI} = £2(oo){|u;,)(o.,|} , (IV.27) 
/C2(£o) = £2(00), (IV.28) 

where the operator-Laplace transform in the second 
equation is interpreted as resulting in the first equation. 
This general relation also reveals the asymptotic prop- 
agator from Eq. (IV. 22) as correctly being the rational 
approximant 



Qoo{s) = s-/C(£o) 



(IV.29) 



to second order, assuming the degenerate dynamics also 
work out correctly. 



1. The Pauli Master Equation 

Just as for the time-local master equation, the nonlo- 
cal master equation is confronted with degeneracy in the 
stationary states. Here we must find the correct linear 
combination of diagonal matrices q , and associated vec- 
tors c[i = q which branch under perturbation 

V(s)q(s) =(5fc(s)q(s), (IV.30) 
(^.1 V(s) = (^,|/C2(s){K-)(^,|}|^,) , (IV.31) 
where from similarity (IV. 18) we have the correspondence 



V(s) = sW(s), 



(IV.32) 



to the time- local Pauli master equation, Eq. (III. 66). The 
asymptotic dynamics follow in accord with the time-local 
master equation but the full-time evolution is, in general, 
exceedingly complicated from this perspective. Full-time 
solutions may only be feasible in either the Markovian 
limit, where it is trivial, or in the zero temperature limit, 
where W is upper triangular in accord with the lack of 
thermal activation. 



NON-MARKOVIAN QUANTUM 
REGRESSION THEOREM 



An open-system master equation provides a propaga- 
tor Q{t) and super-adjoint propagator {t) such that 



Tr[Xg(0{p}]=Tr[gt(i){x}p' 



(V.l) 



Given this, one could construct a "Heisenberg picture" 
via X(i) = Q\t){yi}. However, for multi-time correla- 
tions this "Heisenberg picture" does not necessarily have 
any relation to the Heisenberg picture of the microscopic 
model. This is very easy to see, as in general 



(Xi(ii)X2(t2))E^(Xi(<i))E (X2(i2))E 



(V.2) 



For the closed system or an open system driven by 
Markovian processes, the Quantum Regression Theorem 
asserts that the dynamics of multi-time correlations can 
be generated via C{t) or more specifically its super- 
adjoint C\t). However this is a defining property of 
the Markovian process and will not hold true in the non- 
Markovian regime. 

In this section we approach the category of non- 
Markovian dynamics which cannot be described by the 
regression theorem. First we derive the adjoint master 
equation, which is dual to the ordinary master equation. 
Following this simple derivation, that of the two-time cor- 
relations is more straightforward. 



A. The Adjoint Master Equation 

First we would like to derive the (super) adjoint master 
equation for the dynamics of single-time operators 



x(t) = ({x}(t))j, = (gUt)m 



(V.3) 



As we already know the ordinary master equation, no 
new information will be gained in doing this, but the 
basic procedure will remain largely the same for multi- 
time correlations. The super-adjoint propagator satisfies 
the differential equation 



^gt^(t) = gt^(t)4(<), 



(V.4) 



where here in the unitary theory of the system -I- envi- 
ronment we have 



£T,(t)X= [+zHc(i),X] , 



(V.5) 



and therefore our adjoint master equation can be ex- 
pressed 

±{t)^g\t)[cl{t)y.] + l^gUt)c\{t){X\)^ , (v.6) 

where we have used the fact that C\^{t){'S.} = for sys- 
tem operators. We want to express the right-hand side in 
terms of single-time operators, therefore the second term 
is cast into the form of an adjoint super-operator 

Mt) = g\t)[cl{t)yL] + g\t)[5c\t)y.] , (v.7) 

(V.8) 
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which will be calculated perturbatively. To do this, first 
we express the closed system propagator via the interac- 
tion picture where 

GUt) = Q!c(i)Sl{t), (V.9) 

cl{t)^g^Ht)cl{t)gl{t). (v.io) 

The interaction picture propagator then has the integral 
equation of motion 



Jo 



(v.ii) 



which is directly amenable to perturbation theory via 
Neumann series expansion. Ordinary perturbation the- 
ory then reveals the lowest order correction 



/rfr(£j(r)£j(t) 



(V.12) 



and one can see that this is indeed the super-adjoint of 
Eq. (III. 10). More specifically, for the sum of separable 
couplings the super-adjoint master equation resolves to 



4(f) x = 



(V.13) 



^ { (A„,„ o L„,y [X, L„] + [L„, X] (A„„i o L,„) } 



B. Two-Time Correlations 

For two-time and other multi-time correlations, one 
should note that there will be no assurance of a Quantum 
Regression Theorem 

(V.14) 

given a non-Markovian process. Here we look for pertur- 
bative corrections to the standard QRT formula. After 
application of second-order perturbation theory, of the 
same form as was used for the adjoint master equation, 
the standard QRT terms on the right-hand side are seen 
to match the zeroth-order terms and most of the second- 
order terms of the left-hand side. The second-order re- 
mainder is such that 

Xi(ii)X2(t2))^ = (^[cHh)x,]ih){x,}{t2) 



dT(cl{h){x,{h)}ci{T){x,(t2)y 

Q \ /t 

(V.15) 



and it is also revealed, but not directly shown here, that 
it is imperative to cast the standard QRT terms inside 
a single environmental trace, as to cancel certain highly 
secular terms. 

A general non-secular perturbative fit to this expres- 
sion is not so obvious, so we will resort to a more spe- 
cific model. For a constant Hamiltonian with separable 



coupling to a stationary environment, the second-order 
non-Markovian corrections to the QRT evaluate to 



-J2i^n(.tl),X,ih)] 



dr anm (i 1 , t) L,„ (r) , X^ (t2) 



(V.16) 



in agreement with Ref. [ ]. The two-time integral 

2 

dTa„„(ii,r)L„(T) = ^o(ii) {(A„„ o L„)(ti, ts)} , 

(V.17) 

can be expressed in terms of ordinary second-order oper- 
ators as 

(A„mOL„i)(ti, ^2) = (A„„iOL,„)(ti) — (A„mOL„i)(ti— -^2) , 

(V.18) 

and it should be noted that this non-Markovian correc- 
tion requires no renormahzation as it involves the differ- 
ence between two ordinary second-order operators. The 
most natural non-secular expression to fit (V.16) to is 



{ [L„ , Xi ] } (t 1 ) { ( A„„, o L,„ ) (t 1 , t2 ) } (ti ) , {X2 } (i2 ) 



(V.19) 

which is obviously non-VIarkovian and cannot be ex- 
pressed as a sum of two operators evaluated at two times. 
Note that, although it was necessary to place the stan- 
dard QRT terms inside a single environmental trace, at 
least here at second order, the corrections may be consid- 
ered as a product of single-time operators or a collective 
mutli-time correlation. Higher-order perturbation the- 
ory might reveal which representation is superior (in the 
stronger-coupling regime) as second-order perturbation 
did for Eq. (V.15). 

These non-Markovian corrections do not vanish in the 
weak coupling limit (second-order) but, from Eq. (V.18), 
if ti > t2 they will vanish in the Markovian limit. More 
generally, the two-time operator vanishes in the softer 
limit of ti ^ t2, as compared to the system and envi- 
ronment timescales, much in the same manner that the 
master equation takes its stationary limit. The station- 
ary limit of this expression does not merely require late 
times, but also a similarly lengthy span of time between 
the two times of the correlation. So, even at late times 
when one has a time-homogeneous master equation, the 
non-Markovian property does not go away. This should 
not be surprising as the noise process does not stop being 
non-Markovian. 



VI. THE QUANTUM LANGEVIN EQUATION 

The quantum Langevin equation [ ; , ] is well under- 
stood in the context of bilinear position-position cou- 
plings between the system and environment. Here we 
would like to extend the simpler theory by consider- 
ing quantum Langevin equations that correspond to the 
same class of Gaussian influences which appear in the 
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second-order master-equation and influence-functional 
formalisms. Our motivation is to compare behavior with 
the master equation, to better decompose and identify 
the roles of the environment's influence kernels, to dis- 
tinguish the stochastic and dissipative forces engendered 
upon the system from ordinary forces engendered upon 
the system, to promote a natural notion of the open sys- 
tem's energy, and finally to promote a proper criteria 
for renormalization. In this sense the quantum Langevin 
equation is a powerful pedagogical instrument, despite 
the fact that it is not as useful for practical quantum 
calculations. 

We begin with the same Hamiltonian for our system 
and environment 



He Hs + Hi + He , 
Hi(t) =^L„(t)0l„(i), 



(VI.1) 
(VI.2) 



and the Heisenberg equations of motion for any system 
operator X(i), as driven by the environment, is therefore 
given by 

X(t) = +z[H(t),X(t)]+i^[l„(t)®L„(t),X(t)] . 

(VI.3) 

To generate a Gaussian influence, we specify the environ- 
ment to be comprised of simple (non-parametric) oscilla- 
tors linear in its driven dynamics 



fe 



(VI.4) 
(VI.5) 



and its coupling to be a general linear and time- 
dependent coupling. Let us define the "phase-space" vec- 
tors 



(VI.6) 
(VI. 7) 



The Heisenberg equations of motion for the environment 
operators, as driven by the system, may then be ex- 
pressed conveniently 



Zfc(t) = 



1 



Zfc 



1 

-1 



(VI.8) 



so that the driven solutions of the environment operators 
are given by 



Zfc(0 = *fc(<)zfe(0) 



/drV*fe(i-r) 



1 

-1 



(VI.9) 

gfem(i) Lm(T) , 



in terms of the free environment transition matrix $ and 
Green function /, given by 



fkit) 



fk{t) fk{t) 
fkit) fkit) 
sin(wfet) 



(VI.IO) 



(VI.ll) 



A straightforward calculation then reveals the collective 
coupling operator of the environment to take the driven 
form 



lnit)=Ut) + 2 



E 



dTfIr,mit,T)LraiT), (VI.12) 



where, assuming the environment to be initially in a 
Gaussian state, ^„(i) is an operator- valued Gaussian 
stochastic process, with two-time correlation function 

itait) ^mi'r)) ^ = a„„(i,T) = Vnmit,T) +«^„„(i,T) , 

(VI.13) 

in terms of the noise kernel v and dissipation kernel /z, 
given by 

^n™(i,T) = /^{|„(<),CM}) , (VI.14) 



2i 



[init),i.Ar)\ 



(VI.15) 



which will be discussed more thoroughly in Sec. VII B. 
Curiously, if we couple the system to a environment 
of parametric oscillators, then the memory kernel in 
Eq. (VI.12) will not be determined by the commutator 
in Eq. (VI.15), whereas parametric coupling to a en- 
vironment of simple harmonic oscillators has no effect 
upon this relation. Therefore the "canonical" quantum 
Langevin equation we present corresponds to a particu- 
lar microscopic interpretation of non-stationary correla- 
tions. This also appears to be the case for the infiuence- 
functional formalism. 

Substituting (VI.12) back into (VI.3) results in a quan- 
tum Langevin equation for the open system. However, 
due to the fact that \{t) commutes with system oper- 
ators at all times, whereas the operator noise ^(t) and 
dissipation (apart) do not, there is no unique method 
of expressing the quantum Langevin equation in a man- 
ifestly Hermitian manner. All representations generate 
equivalent solutions, but some are more robust with re- 
spect to approximation than others. In particular, non- 
Hermitian representations are rather pathological as they 
only preserve Hermiticity upon noise averaging. The 
second-order adjoint master equation (V.13) would ap- 
pear to suggest the following representation 

X(t) = +1 [H(i), X(i)] +'-Y^ {l„(t), [L„(t), X(i)]} , 

(VI.16) 

lnW=l„W+2V f dTHnmit,T)-LrniT). (VL17) 
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Although we have derived this Langevin equation under 
the assumption of a hnear environment, we may apply it 
self-consistently for any Gaussian influence.^ The quan- 
tum Langevin equation here is nonperturbative, how- 
ever it only approximates non-Gaussian environments 
in a perturbative manner. Therefore it parallels the 
second-order master equation quite well. Finally note 
that in the corresponding classical Langevin equation, 
^nit) would be real Gaussian noise with two-time corre- 
lation J/, and the dissipation kernel would only appear as 
given in Eq. (VI. 17). That the dissipation kernel appears 
in the operator-noise average is a quantum feature which 
is made less than obvious with the choice oi h = 1. 



A. The Damping Kernel 

Here we will use the Langevin equation (VL16) to de- 
termine the role of the dissipation kernel and to motivate 
an appropriate method of renormalization. The correla- 
tion function a(t, r) is positive definite and therefore the 
noise kernel u{t^T) must also be positive definite. How- 
ever the dissipation kernel r) is not positive definite, 
but it is related to the damping kernel ^(t, r), which is 
given by 



7(i, r) = 27o5(< — r), the slip generates the instantaneous 
unitary transformation 



d_ 



lit, 



(VL18) 



and can be positive definite, negative definite or indefi- 
nite, as will be discussed in Sec. VH B. For non-stationary 
noise, Eq. (VL18) is an incomplete definition, and con- 
structing a symmetric damping kernel will require addi- 
tional considerations. Assuming relation (VI. 18) is suf- 
ficient, which is the case for stationary correlations, the 
nonlocal term present in the Langevin equation can be 
represented as 



t pt 

dr fInmit,T)L.rn{T) ^ / dr 7„,„ (t , t) L,„ (t ) 

Jo 



dissipation damping 

{t,t) L„.(t) + (t,0)L,„(G). (VL19) 



rmalizablc 



slip 



In the damping-kernel representation we now have three 
terms: nonlocal damping, renormalizable forces, and 
transient "slip" forces. The nonlocal damping and renor- 
malizable forces will be more thoroughly considered in 
the following sections. The transient slip is a peculiar- 
ity associated with factorized initial conditions, and can 
be avoided with the consideration of a properly corre- 
lated initial state [14]. In the most extreme case, for 
Ohmic coupling with a delta-correlated damping kernel 



Note that one needs to include inverted oscillators in the envi- 
ronment to mock general correlation functions. 



X 

p — > e 



g+i7oL ■j^g-i7oL 



pe ' 



(VI.20) 
(VL21) 



which one can invert to identify a more properly corre- 
lated initial state, as discussed in [ ]. 

Given a symmetric damping kernel, which is the case 
for stationary correlations, our quantum Langevin equa- 
tion can then be expressed as 

X(t) = +z [Heff (t), X(t)] iUt), [L„(i), X(i)]} 

n 

+ /"dr7„™(t,r){L,„(r),[L„(t),X(t)]} , (VI.22) 

when discarding the transient slip and where the effective 
Hamiltonian is given by 

Heff (t) = H(t) - J2 7nm(t, t) L„(t) . (VI.23) 

nm 

We call this term the effective Hamiltonian and not the 
renormalized Hamiltonian, as the correction may con- 
tain both divergences which require renormalization and 
terms which describe completely new environmentally- 
induced forces. A canonical example of this is non- 
equilibrium electrodynamics, wherein these corrections 
contain both the mass renormalization of the electron as 
well as the magnetostatic forces between electrons [44]. 

1. Renormalization 

Given a symmetric damping kernel, one can see from 
Eq. (VI.22) that the open system experiences effective 
forces as generated by the Hamiltonian 

Heff(t) =H(t)-^L„(t)7„™(t,i)L„(t). (VI.24) 

nm 

For local damping this necessitates renormalization. 
Moreover, it is physically imperative that renormaliza- 
tion is only performed among these terms in the Langevin 
equation. This is not so apparent from the second-order 
master equation, as one has the unitary generator H-f-V, 
with 

V = ^ ^ [L„ (A„„jO L,„) - (A„„iO L„j)^ L„] , 

nm 

(VI.25) 

which contains a vast number of terms in addition to 
effective forces. The effective-force terms will be more 
clearly delineated in Sec. VII Bl. The following section 
on energy damping will also motivate the perspective 
that Hoff (i) becomes the more relevant energy of the open 
system. 



21 



2. The Energy-Damping Property 

To demonstrate that a symmetric damping kernel can 
be given a physical interpretation we will consider the 
time evolution of the effective system Hamiltonian. First 
we will require the time evolution of the system-coupling 
operators 



t„r{t) = +t [Hcff(i),Lm] 



(VI.26) 



This relation is exact if all of the system coupling opera- 
tors L„ commute, otherwise it is only perturbative. Now 
we feed Eq. (VI.24) into Eq. (VI.22), apply the above 
relation, and integrate to obtain the open-system energy 
as a function of time 



HeffW=Heff(0)-H^(i)+H5(i) 
ft rt 



(VI.27) 



H^W -+E / dT'7„™(r,r')|L„(r'),L,„(r)| , 

nm-^O Jo J 

(VI.28) 

Hc(t)--E^{^"W'L"W} , (VI.29) 



in Sec. Ill A 3. Nonlocal decoherence only implies that 
there is more net decoherent evolution than recoherent 
evolution, as per Eq. (III. 63). The stricter property of 
decoherence at every instant in time, A(f) > 0, will 
only be satisfied generally by delta correlations which 
exhibit local decoherence. Such correlations will always 
produce a Lindblad master equation, as can be inferred 
from Eq. (III. 52). However some very restricted classes 
of system-environment interactions, such as the RWA- 
intcraction Hamiltonian [ ] , can be constrained by their 
coupling to be instantaneously decoherent. This charac- 
terizes the class of systems with non-Markovian dynam- 
ics whose master equation is, nevertheless, naturally of 
Lindblad form, though not necessarily at all times. 

Finally we note these stochastic processes are partially 
ordered in their decoherence strength. Given two correla- 
tion functions, one can sometimes order them oi+{t, r) > 
Q:_(t,T) according to the positivity relation (VII. 2). For 
instance, the set of univariate Markov processes is to- 
tally ordered by the scalar magnitude of the respective 
delta correlations, e.g. 2S{t—T) > 16{t—T). This idea is 
given more consideration, including nontrivial examples, 
in Ref. fHil. 



when neglecting the transient slip. This relation reveals 
that a positive-definite damping kernel will only decrease 
the system energy, whereas a negative-definite damping 
kernel will only increase the system energy. The criteria 
for each conditions will be more thoroughly covered in 
Sec. VII B 2. This expression for H^(i) also contrasts 
nonlocal damping to local damping. Evaluation with a 
delta correlated damping kernel yields damping which 
is strictly dissipative at every instant of time whereas 
nonlocal damping is only assured to be accumulatively 
dissipative in the full-time integral. 



VII. ENVIRONMENTAL CORRELATIONS 



2. Time-Dependence and Stability 

Stationary correlations are defined by their invariance 
to time translation 



a.{t, r) = cy.{t~T) , 



(VII.3) 



and can produce asymptotically stationary (time- 
constant) master equations. Such correlations are pro- 
duced when the environment is in an initially stationary 
state 



Pe(0) = ^pe(£») \ei){e. 



(VII.4) 



A. Classification of Correlations 

1. Positivity and Decoherence 

The (multivariate) environmental correlation function, 
first defined in Eq. (HI. 19), is Hermitian in the sense of 

a{t,T) = a\T,t) , (VH.l) 

and also positive definite in the sense of 

/ dn f dT2 f^(ri) a(Ti, ra) f (ra) > , (VII.2) 
Jo Jo 

for all vector functions f{t) indexed by the noise. All 
quantum correlations are at least nonlocally decoher- 
ent: any resultant algebraic dissipator will be positive 
definite for all time, A(i) > 0. This property is re- 
quired for completely-positive time evolution as proven 



where \e) denotes the energy basis of the environment and 
Pe(£) are its stationary probabilities at the initial time. 
Furthermore the coupling operators must be constant in 
time, resulting in 

a„™(i, r) = ^pE(£^) (ei| U kij) Im |£»i) e+'^^'(*"^) . 

(VII.5) 

Comparing to the mode sum 



a{t) ^ / duj e+"^* a{uj) , 



(VH.6) 



the accompanying characteristic function can be readily 
identified as 



(w) oc 27r^pE(£i) (ei| U | 



(VII. 7) 
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where the underscored proportionahty here is strictly 
in reference to the continuum hmit of the environment 
which relates environmental mode sums to integrals given 
the infinitesimal strength of individual environmental 
mode couplings. This can be more rigorously defined 
through the use of a finite spectral-density function in 
place of the infinitesimal environment couplings. 

Also of note are quasi- stationary correlations such as 
of the form 

a{t, t) = as{t-T) + Sa^sit + r) , (VII.8) 

where as {t — r) denotes a stationary correlation while 
(5aNs(^+''") is an additional non-stationary contribution. 
Such correlations will result from linear coupling to an en- 
vironment with non-stationary initial state. Other kinds 
of quasi-stationary correlations can result from quadratic 
coupling, etc. Due to their highly oscillatory behavior in 
the late-time limit, given the Fourier representation 

Sa^s{t+T) = — / dee+'^(*+^) 6a^s{e) , (VII.9) 

the non-stationary dynamical contributions typically lose 
effect therein. Therefore quasi-stationary correlations 
can produce an asymptotically stationary master equa- 
tion with equivalent asymptotics as generated by their 
corresponding stationary projection ctg. 

Cy do -stationary correlations are defined by their in- 
variance to periodic translations 

a(ti,t2) - a(ti+r,<2+T), (VII.IO) 

and can produce asymptotically cyclo-stationary (peri- 
odic) master equations. Such correlations are produced 
when the environment is in an initially stationary state 
and its coupling operators are periodic in time 

In(^) = 4"' e+^""«* , (VII. 11) 

u 

where fin — \s the interaction period. The correlation 
function Q;(ii,t2) can then be expressed as 

UV 

(VII.12) 

in terms of the stationary kernels 

(VII.13) 

and such that the non-stationary factors of the full corre- 
lation function are more obviously periodic. Equivalent 
correlations are produced when the environment is in an 
initially cyclo-stationary state and its coupling operators 
are constant in time. I.e. the environmental modes have 
Floquet-normal-form solutions such that the coupling op- 
erators admit the spectral decomposition 

m = E e+'"^^«* , (VII.14) 



where |e) denotes the pseudo-energy basis of the environ- 
ment associated with the Floquet-normal-form solutions 
and is the period of the environment Hamiltonian. 



B. Correlation Function Decomposition 

Second-order correlation functions can always be de- 
composed into a real noise kernel and dissipation kernel. 

a{t,T) ^ iy{t,T)+i ti{t,T) , (VII.15) 

complex noise noise dissipation 

The dissipation kernel nomenclature is slightly mislead- 
ing as this kernel may engender a host of effects, with 
dissipation (used in the physical sense to denote lost in 
energy , not states) key among them. The Hermiticity 
stated in Eq. (VII. 1) leads to the relations 

u{t, r) = i [a(t, t) + aV, t)] , (VII.16) 
M(t, r) = i [a{t, t) - aT(r, t)] . (VII.17) 

The role of each kernel can be inferred from the influ- 
ence functional [41, 52] and quantum Langevin equation 
(see Sec. VI). The noise kernel v appears in the influ- 
ence kernel as the correlation of an ordinary real stochas- 
tic source, whereas the dissipation kernel fj, alone would 
produce a purely homogeneous (though not generally 
positivity- preserving) evolution. 

For stationary correlations ctit — r) with characteris- 
tic function (Fourier transform) a{uj), the real noise and 
damping kernels are then Hermitian in both noise index 
and frequency argument 

iy{u}) = u^{u}) = i>*{~uj), (VII.18) 
j{oj)=j\lu)=j*{~u:), (VII.19) 

where for stationary correlations the damping kernel 7 is 
uniquely defined by the relation 

Kt) - j^lit) , (VII.20) 

This kernel was first introduced for the Langevin equa- 
tion in Sec. VI and will be further discussed momentarily. 
One implication of this double Hermicity is that, in the 
noise index, their real symmetric parts are even functions 
of the frequency while their imaginary anti-symmetric 
parts are odd functions of the frequency. More impor- 
tantly, from Bochner's theorem both a.{uj) and £'(w) are 
positive-definite for all frequencies. The damping ker- 
nel ^(w) may be positive definite, negative definite, or 
indefinite. 

The two kernels naturally decompose the second-order 
operators, Eq. (III. 18), into their Hermitian and anti- 
Hermitian parts, in the ordinary sense of Hilbert space 
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operators. 



(N„„oL„i)(t) = 



(M„„oL„i)(t) = 



(VIL21) 

{t,T) {go{t,T)L„,{T)} , 

(VIL22) 

t 

f-^nm 

{t,T) {go(i,T)L„(T)} , 

(VIL23) 




where again, there may be more effects in these "dissi- 
pation" coefficients than dissipation. The second-order 
master equation can then be expressed entirely in terms 
of Hermitian operators 

A P = [L„,i{(M„„,oL,„),p} + [(N„„oL„i),p]] . 

nm 

(VII.24) 

Here the noise coefficients describe diffusion while the 
dissipation coefficients describe dissipation (or the oppo- 
site), renormalization, and other homogeneous dynamics. 

The correlation function a(t, r) is positive definite and 
therefore the noise kernel ^{t, r) must also be positive 
definite. The dissipation kernel fj,{t, r) is not positive 
definite, but it is related to the previously mentioned 
damping kernel 7(t,r), which is given by 



/x(i,r) 



l{t,T) 



(vn.25) 



and can be positive definite, negative definite, or indef- 
inite. For non-stationary noise, Eq. (VII. 25) is an in- 
complete definition, and constructing a positive-definite 
damping kernel may require additional considerations. 
Assuming relation (VII. 25) is sufficient, the dissipation 
kernel coefficients can then be expressed 

(M„„ o L„j)(t) = (r„,„ o L„i)(t) - 7„,„(t, t) L,„(t) 

v ' V ' ^ ' 

dissipation damping rcnormalizablc 

+ 7nm(t,0){go(i)L™(0)}, (VII.26) 



slip 

in terms of damping kernel coefficients 

(r„m O 

(VII.27) 

L„(i) = +z [H(<), L,„(t)] + |^L„(i) , (VII.28) 

ot 

which can be used to place Eq. (VII.24) into a form much 
like the QBM master equation [18, 20]. Note that if 
the L„(t) do not commute, then Eq. (VII.28) is missing 
higher-order corrections. The slip is a transient effect, 
a result of the factorized initial conditions, and will be 
avoided by the preparation of a properly correlated initial 
state []4]. The renormalizable terms cause a long-lasting 
shift of the system Hamiltonian which diverge in the limit 
of local or simple damping. 



1. Renormalization 

Note that from the master-equation perspective we 
have a host of unitary generators V, given by Eq. (VI. 25). 

V = — ^ [L„ {AnmO Lm) - (A„,„0 L„i)^ L„] , 
nrn 

(VII.29) 

to second order. It is not advisable to renormalize all 
of these terms as (1) many of them are physical and (2) 
doing so will not produce a homogeneous dynamics of 
interaction system which are most similar to that of the 
free system. 

The renormalizable terms identified above in 
Eq. (VII.26), by guidance from the damping ker- 
nel, are equivalent to those more rigorously identified 
in the quantum Langevin equation (Sec. VIAl), where 
the effective Hamiltonian for the open system is now 
identified as 

Heff'(t) = H(t) - ^L„(07nm(t,i)LmW • (VII.30) 



2. Classification of Damping Kernels 

From Sec. VI A 2, environments with positive-definite 
damping kernels are damping or resistive environments, 
while those with negative-definite damping kernels are 
amplifying. If the coupling variables L„ are position vari- 
ables, the damping terms correspond to forces linear in 
momentum (or velocity). Stationary correlations are the 
easiest to dissect. Their dissipation and damping kernels 
are related by 



=«£7(e), 



(VII.31) 



and from the definition of the dissipation kernel in 
Eq. (VII.17) and the double Hermiticity in Eq. (VII.19)- 
(VII. 18), the damping kernel will be most-generally pos- 
itive or negative definite if we have a strict inequality 
between positive and negative-energy argumented corre- 
lation functions. 



a(-|^|)>a*(+|c.|) 
a(-|^|)<a*(+|^|) 



(Damping) , 
(Amplifying) 



(VII.32) 
(VII.33) 



Using Eq. (VII. 7), one can show that damping environ- 
ments result when the initial environmental state prob- 
ability pe{£) is a monotonically decreasing function of 
the environment energy. Amplifying environments result 
from monotonically increasing functions or population in- 
version. The most common example of each being posi- 
tive and negative temperature reservoirs. 

The justification for this notion of resistive and am- 
plifying environments was given rigorously in Sec. VI A 2 
by means of the quantum Langevin equation, however 
the second-order master equation gives a perturbatively 
consistent account. Given our damping representation of 
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the master-equation coefficients and the adjoint master 
equation (V.13), one can determine the dynamics of the 
open-system energy (power) to be 



off — 



(VIL34) 

where we have neglected any power generated by the shp 
and time-dependence intrinsic to the couphng operators. 
Using the zeroth-order solution p{t) — QQ^t) p{0) and 
symmetries of the damping kernel, the second-order ex- 
pectation value for energy lost through damping can be 
represented as 



y"dr(4(T)Heff(r)) = (VII.35) 

■t nt 

dTi / dT2^7„™(ri,T2)Tr L„(ri) p(0) L„(t2) 



which will be strictly dissipative for a positive-definite 
damping kernel. This expression also contrasts nonlocal 
damping to local damping. Evaluation with a delta corre- 
lated damping kernel yields damping which is strictly dis- 
sipative at every instant of time whereas nonlocal damp- 
ing is only assured to be accumulatively dissipative in the 
full-time integral. 



3. Fluctuation- Dissipation Relations and Inequality 

From the definitions of the noise and damping kernels, 
Eq. (VII.15)-(VII.17), one can easily prove the (station- 
ary) fluctuation-dissipation inequality: 



I>(cli) > ±Ll! 7(0;) . 



(VIL36) 



To prove this one simply notes that the noise kernel is 
the sum of two positive-definite kernels whereas the dis- 
sipation kernel is given by their difference. The essential 
point is that if there is any damping, or amplification, 
there will be quantum noise and Eq. (VII. 36) determines 
its lower bound. This is quite a departure from clas- 
sical physics where noise can be made to vanish in the 
zero temperature limit. The FDI and its relation to the 
Heisenberg uncertainty principle is discussed more thor- 
oughly in Ref. [. , ]. 

For the case of one collective environment coupling, it 
is sufficient to define a fluctuation- dissipation relation 



i>(a;) = k(w)7(w) , 

k{uj) = — - , 
7 w 



(VIL37) 
(VIL38) 



with k{Ld) the FDR integration kernel which relates fluc- 
tuations to dissipation. For multivariate noise one could 
use the symmetrized product 

i>(^) = i [k{io) 7(6.) + j{uj) kioj)] , (VIL39) 



which would ensure k{uj) to be positive definite if 7(w) 
is, in accord with this being a (continuous) Lyapunov 
equation [53]. Inequality (VII. 36) can then be restated 



as 



k{uj) > \uj\ 



(VII.40) 



for damping environments. Typically k{uj) will contain 
dependence upon the precise nature of environment cou- 
plings 1„ (t) , in that if one changes the couplings then the 
FDR also changes. 



VIII. THERMAL RESERVOIRS 

In this section we describe many of the important prop- 
erties of thermal reservoirs and their corresponding cor- 
relations. In the first subsection we demonstrate the 
equivalences between the fluctuation-dissipation relation, 
Boltzmann distribution, KMS relation ['i4, 55], and de- 
tailed balance in the master equation. 



A. Derivation of Thermal Correlations 

1. The Fluctuation- Dissipation Relation 

As explained in Sec. VII B 3, a fluctuation-dissipation 
relation can be almost any (possibly tautological) rela- 
tion between the noise and damping kernels, though such 
relations are somewhat constrained by quantum mechan- 
ics. However, if the FDR is to be independent of precisely 
how the system and environment are coupled, or 1„, then 
one can work out from Eq. (VII. 7) that the FDR kernel 
K must be a scalar quantity, directly related to the initial 
state of the environment by way of 



Pe{s-uj) +pe{£) 



Lo p-E{£-io) -_pE(e) ' 
for all e. But this implies the functional relation 



(VIII. 1) 



PE{£-i^) 



1 



1 



PE(e) 



(VIII.2) 



where the lj translations can factor out. This factoriza- 
tion property is unique to exponential functions, there- 
fore only the thermal distribution pe(£) oc e"*^^ can pro- 
duce a fluctuation- dissipation relation which is generally 
coupling independent. We then have the thermal FDR 
kernel 



k{u}) — ui coth^ 



2T) 



(VIII. 3) 



which must be maintained no matter how the system is 
coupled to the environment. Returning all dimensionful 
constants reveals the high-temperature and semi-classical 
FDR 



lim k{uj) — lim k(uj) = 2T . 



(VIII.4) 
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2. KMS Relations 

Here we will detail the form of correlations that all 
thermal reservoirs generate. We simply assume that our 
ideal reservoir is in a thermal state 



1 — £i 



k 



(VIII.5) 
(VIII.6) 



Next we perform the change of variables — ?> + ^ 
on Eq. (VII. 7) to expose the inherent symmetry in all 
thermal coefficients. 



, . 2tt -s-^ _£fc 



(VIII.7) 
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where the last factor defines a positive-definite matrix (in 
the noise index) which is Hermitian in both the noise in- 
dex and frequency argument. The damping and noise 
kernels exhibit double Hermiticity [see Sec. (VII B)], 
whereas the thermal correlation function exhibits ordi- 
nary Hermiticity in the noise index and the thermal 
(a)symmetry 



a{+Lo) = a^{~uj) e ^ = a*{—uj) e 
in its frequency argument. 



(VIII. 



detail in the system to be balanced, then Eq. (VIII. 10) 
can be satisfied trivially. Such is the case with a system 
consisting of a single oscillator which can only asymptote 
into a Gaussian state with linear coupling [11]. But for 
detailed balance to be attainable in any system, certain 
transitivity properties must be present in the environ- 
mental correlations, e.g. 



(wfci) a 



mn \^jk ) 



(VIII.ll) 



which is known as detailed balance of the master equation 
or equivalently detailed balance of the correlations. Tran- 
sitivity is a unique property of the exponential function, 
and therefore only Maxwell-Boltzmann states 



prp on e 



-pa 



(VIII.12) 



and thermal correlations, Eq. (VIII. 8), can non-trivially 
satisfy this constraint for asymptotic states which are in- 
sensitive to the precise nature of the system-environment 
coupling. Given that thermal reservoirs generate thermal 
correlations, it can be said that the thermal state is the 
only state which is self-replicating. Any other stationary 
reservoir will induce a stationary state upon the system 
which does not generally resemble that of the environ- 
ment. 

Furthermore we can also say something about dynam- 
ics of thermalization with an old proof from the theory of 
Markov chains and Pauli master equations. Notice that 
given detailed balance, W is similar to a real, symmetric 
matrix 



3. Detailed Balance 

Equilibrium states are stationary states, though not 
all stationary states are equilibrium states. To lowest or- 
der in the coupling, stationary states p are diagonal in 
the energy basis. The stationary constraint is given by 
the Pauli master equation W (III. 66), and takes the form 
W p = 0, where p denotes the diagonal entries of the sta- 
tionary state. In terms of the environment correlations, 
this works out to be the vanishing of all sums 
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This constraint must be satisfied by any stationary state 
of the system. Moreover, if the thermal state is to be 
insensitive to the precise nature of the system coupling, 
then the more strict constraint 
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must be satisfied; this stronger constraint of term-by- 
term cancellation is known as detailed balance of the solu- 
tions. If this condition is met then the system has reached 
equilibrium with its environment. If there is not much 
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Being real and symmetric, S must have real eigen- values. 
Given the similarity transform, W must share the same 
real eigen- values. The physical implication is that in this 
weak coupling limit, relaxation generated by W is purely 
decay without oscillation. This property will not hold 
when near resonance. 



B. Properties of Thermal Correlations 

From any of the above expressions, all thermal corre- 
lations and noise kernels can be expressed 
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in terms of the damping kernel 7. Alternatively the ther- 
mal correlation and damping kernel can be expressed 
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in terms of the noise kernel v. 

For positive frequencies larger than the temperature 
the correlations vanish, but not necessarily for large neg- 
ative frequencies. This is the asymmetry between ther- 
mal activation and freezing and its lopsidedness is most 
apparent in the zero-temperature limit. 



5[iii] 
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The Markovian regime (complex white noise) corre- 
sponds both local damping and high temperature (lo- 
cal FDR kernel). The nomenclature of "thermal noise" 
as being is not entirely correct, correlations are 
Markovian and high temperature is necessary but not 
sufficient to be in the Markovian regime. Non-Markovian 
thermal noise is perfectly capable of being 1//" noise. 
The Markovian regime is reached when the system time 
scales are much slower than those of the environment, so 
that we can take the low-frequency approximation 



lim7(w) =7o, 
lima(a.) = 27oT. 
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These are the coefficients one would see in the Markov- 
Lindblad master equation as this is the limit in which 
the reservoir time scales are much more rapid than the 
system time scales. 

Occasionally in the literature, zero-temperature cor- 
relations with simple dissipation, //(w) constant in fre- 
quency or 1// damping, are also referred to as being 
"white noise". In this case, the noise kernel v is lo- 
cal and thus the real noise is white, however the envi- 
ronment correlations are nonlocal and thus the complex 
noise which unravels the system evolution is not white. 
This "white noise" does not strictly correspond to the 
Markovian regime. Corresponding to the lack of ther- 
mal activation and the lack of negative energy modes in 
the environment, these correlations only appear white in 
certain respects. The upper left plot in Fig. 1 shows high- 
temperature (complex) white noise, while the lower right 
plot shows low temperature "white noise" . 



For low-temperature noise, the small temperature T pro- 
vides a very long time scale which determines the scale of 
drastic change between positive and negative frequency 
behavior. Low-temperature "white noise" generally re- 
quires an infrared cutoff to be suitable for positive tem- 
perature. High-temperature white noise generally re- 
quires an ultraviolet cutoff to be suitable for finite tem- 
perature. 

Finally, given a simple damping kernel, it is convenient 
to specify the convolution in (III. 48) for our stationary 
coefficients using the rational expansion of the hyperbolic 
cotangent 
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FIG. 1. Environmental correlations ci(w) for high- 
temperature (left) and low-temperature (right) reservoirs, 
given simple damping 7(0;) (top) and simple dissipation /i(a;) 
(bottom). 



so that with proper choice of damping kernel, this con- 
tour integral may be evaluated via the residue theorem; 
we remember that the ±aj poles are regulated away and 
do not count towards the residue theorem. 

Alternatively, given a simple noise kernel, it is conve- 
nient to specify the coefficients using the rational expan- 
sion of the hyperbolic tangent 
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IX. DISCUSSION 

We have given a relatively simple perturbative for- 
malism for the analysis of open-system dynamics and 
addressed concerns such as late-time convergence and 
complete positivity. Master equations not of Lindblad 
form (thus describing non-Markovian dynamics) are of- 
ten viewed with a level of suspicion as they would seem 
to lack some vital structure necessary to ensure positiv- 
ity. We have detailed specifically how this information 
is encoded in the time dependence of all microscopically 
derived coefficients. Moreover, one has to temper expec- 
tations of complete positivity to the relevant perturbative 
order of accuracy generated by an inexact master equa- 
tion. It is not well known that the second-order master 
equation can only provide the diagonal components of the 
density matrix to zeroth-order at late times [i'-i]. There- 
fore when solving the second-order master equation, late- 
time positivity will only be preserved to zeroth-order in 
the late-time regime, and in this regard the Lindlbad 
form is irrelevant. 

It is often suspected that these perturbative master 
equations cannot be employed for significant lengths of 
time, and it is certainly true that the late-time and weak- 
coupling limits do not always commute. However we 
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showed that the master equation can provide correct late- 
time behavior by an expansion in orders of the coupUng, 
provided that the functional distribution of noise is Gaus- 
sian (as to provide cancelation of certain potentially sec- 
ular terms) and that the environmental correlations are 
sufficiently localized. Moreover, one must also be wary 
of what order of accuracy the master equation is actu- 
ally capable of providing at late times. The late-time 
accuracy is strictly less than the early-time accuracy. 

There has also been some debate as to the superior- 
ity of the time-local versus time-nonlocal master equa- 
tion representations. As we have rigorously shown, both 
representations result in the same asymptotic behavior, 
assuming the perturbative formalism is valid. 

In conclusion, in this work we have given a new deriva- 
tion and analysis of the perturbative time-local and 



nonlocal master equation formalism, including solutions, 
non-Markovian quantum regression theorem (QRT) cor- 
rections, nonlinear quantum Langevin equation formal- 
ism, and we have derived a three-way correspondence be- 
tween the fluctuation-dissipation relation (FDR), Kubo- 
Martin-Schwinger (KMS) relation and the detailed bal- 
ance condition. 
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